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\ly purpose in discussing the topic of educational diagnosis is to 
some of the types of considerations that are to be the basis of 
rbook on that subject sponsored by The National Society for the 
of Education, and, in the name of the committee, to invite the 
cooperation of those interested in this field of research. The 
ct has so many varied angles that it will be impossible to do more 
merely sketch some of the problems that educational diagnosis 
it is to be made valid and useful in loeating the causes of in- 
to learn. 
diagnosis we mean the procedure that is used to identify or to 
mine the nature of a deficiency or weakness. The field of medicine 
ts the most outstanding contributions to the techniques of diagnosis. 
medicine, emphasis has shifted from the mere observations of symptoms 
to the systematie application of techniques whose aim it is to determine 
the causes underlying these symptoms. Locating the cause or causes 
makes prognosis possible. 
Just as the physician must have a well-classified knowledge of symp- 
oms of various physical and mental ailments and, if possible, a know!l- 
of the causes underlying them as the basis of diagnosis, so the 
ier should have a systematic knowledge of the most common peda- 
gogical faults and their symptoms and causes in order to make a valid 
gnosis Of a pupil’s inability to progress at a satisfactory rate. It 
s that, in spite of as earefully guided instruction as we are able 
there are pupils who for one reason or another fail to master 
e subject matter and skills that are being taught. Formerly it was 
practice to fail such pupils. In recent years, definite attempts have 
made to alleviate this condition by painstaking studies of learning 
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difficulties and faulty reactions of pupils. As a result of these studiesj 
there has been assembled a very large amount of information helpful 
in edueational diagnosis. It is the purpose of the yearbook to array 
this information in a systematie way and to make it available for workers 
in the field. At the same time, the committee will scrutinize the work 
that has been done, suggest its limitations and deficiencies, and point 
out the types of research that are needed to solve questions that are 
still unsolved, in many eases practically untouched. 

The need of such an array of information is obvious when one recog. 
nizes the fact that-any diagnosis is conditioned by the previous training 
and experience of the examiner. Any diagnosis may be incorrect be-} 
cause of the inability or failure of the examiner to recognize the signs 
or symptoms of the defiiciency, or because of ignorance of fundamental | 
faets concerning learning revealed by scientific inquiry; he may lack] 
knowledge of the factors underlying the learning activity involved and J 
ways in which they operate or are related; he may use techniques and 
devices that are inadequate, careless, and unscientific; the conditions} 
under which the examination is given may be unfavorable or may |x 
inadequately controlléd, hence the responses the pupil makes may not 
be those that he typically makes in the ordinary activities in which the 
occur; the basis on which the diagnosis is made may not be sound, du 
to the faet that important items may be overlooked. Making available for 
teachers reliable objective techniques of diagnosis and training teachers 
in their use will do much to help them to eliminate or at least contro 
those elements in the learning situation that are causing the diffieult) 


It is interesting to note that some of the first attempts at the diag- 9 


nosis of the causes of learning difficulty were made by physicians. The 
investigations of such men as Binet, who worked with subnormal chil- 
dren, come to mind. The removal of such obvious causes of difficult) 
in learning as faulty vision, poor hearing, and similar unfavorab|: 
physical conditions has often been possible. Medical men are obvious!) 
not equipped to locate the causes of many of the learning difficulties 
that arise in the school. Undoubtedly many of their findings may hav 
important bearings on these problems which we at present cannot se 
It is hoped that those interested in the solution of learning difficulties 
will make much more use of the techniques and findings of medicin: 
especially those of bio-chemistry, than they have in the past. It may l« 
that there is a much more intimate relationship between physical ma! 
adjustment and learning difficulty than we have thought existed. 
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‘ucies ine of the very useful contributions to the diagnosis of learning 
Ipful ulty has been the development of standard tests of intelligence. If i" 
Array accepts the definition of intelligence as the ability to learn and 
rkers MM .cumes that these tests measure this aspect of intellect, one ean readily 
Work G® jotermine the relative learning ability of an individual. If he scores : 
point low on these tests, one may say that at least one factor underlying his 
E ary ity to learn may be lack of native ability. During the past few 
there has raged a controversy between those who maintain that 
le ental level of an individual is determined by nature, while others 
ange sist that nurture, that is, environmental factors, are basic. If one 
4 be- es that low mentality as measured by mental tests automatically 
sIQTis § es unmodifiable inability to learn, the task of teaching those of 
anita ow mentality may be regarded as more or less hopeless. If one admits 
lack ur present tests of intelligence may, in many ways, be inadequate, 
andj ily invalid, undue stress will not be placed on their results. Recent 
ane ae st s in the field of learning show that there is much more hope of 
sons ng relatively subnormal children basic essential knowledge and 
yb s than has often been thought possible. It is likewise true that often 
™ en of apparently superior intelligence encounter marked learning 
she ities. It is thus clear that lack of intelligence alone cannot be 
du led as the cause of inability to learn. Other factors are at work 
fo must be determined. 
- ) determine with precision the general level of a pupil’s achieve- 
ur n general and in particular subjects or phases of subjects standard 
Ity of many kinds have been devised. By means of these tests it is 
ag ble to loeate quite definitely the specific phases of particular sub- 2 
he | ‘s in which a pupil may be inferior. One difficulty in interpreting 
hil- | 1 esults of many of the present day tests is the size of the units they 
Ity | Many of them are so large that a single unit represents the average 
ble vth which takes place in a whole semester. At present we have . 
” tically no achievement tests that measure in fine enough units progress . 
on m month to month, much less from week to week, or from day to day. 
ov | such tests are needed is obvious. 
* ne of the findings of measurement by these achievement tests that 
aes important bearing on diagnosis is the apparent specificity of the 





ous learning activities and responses which constitute such general 





ities as reading or arithmetic. Experiments have demonstrated that 






cifie skills, such as rate of reading or ability to select the main topics 
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outcomes that may be more valuable. Certainly it is true that a diagnosis 
based on a mere achievement test of knowledge and skills is not a valid 
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one, nor is it penetrating. Other outcomes must be considered. 





The fact of variability of performance must be borne in mind in § 
any interpretation that may be made of the results of most of our de- BR ,,,., , 
tailed diagnostic tests. A common procedure is the analysis of test B® ,),. 
papers by the teacher to determine the specific difficulties of pupils 


For example, the teacher examines a test paper in arithmetic to determin 7 
the types of examples that were solved incorrectly. After this informa aamuual 
tion has been secured, the teacher assigns practice exercises on simila! ae ny 
types on the apparent assumption that failure to solve an example cor- pa 
rectly is proof that the pupil does not know how to solve similar examples, eh 


or at least needs practice on them. 
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papers to discover the types OF errers Lue yariuus pupa sic hen 
he made a similar analysis of the errors found in their written work 
| classes. He concluded that the results of the diagnostic tests did 

not furnish a valid basis of diagnosis since the pupils did not make the 
same kinds of mistakes in their usual written work that they made on 
tests. He also found that there were errors on the regular work 
did not appear on the test. To insure validity, a test of ability 
sunetuate should adequately sample the range of situations in which 
skills involved in punctuation may be used. The test should also 
sample the varying reactions of the pupil to the same situation. For 
uple, the pupil may be able in one case to punctuate today but not 
row. Some provision must be made for choosing sample situations 


h inelude the known variables which are most likely to affect the 
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of paragraphs, will readily respond to corrective measures or practic 
without apparently affecting in any way the other skills which go t 
make up the general ability to read. Profiles showing the comparative 
level of development of the various skills for individual pupils are high) 


irregular and uneven. This variability may be due in part to differences! 


in training, possibly to innate differences in the individual himself 
possibly to inaccuracy of the measuring instrument. The chief point 
to emphasize concerning this condition is the great variability in all 
human performance. This same phenomenon is also characteristic of 
the physical mechanism and all of its reactions. From the point of view 
of diagnosis this variability in performance is very signifieant. It sug 


gests the inadequacy of any diagnosis based on a general test of per. 
formance. It seems essential to prepare a series of reliable tests off 


specific skills much more carefully constructed than any that are nov 


available. The scope of these tests should be broadened so as to include! 


the outcomes of learning such as interests, appreciations, ability to apply 
and the like which to many are even more important than the outcomes 
that we are now able to measure. Tyler, for example, has proposed 
that instead of merely preparing tests to measure the information pupils 
may aequire, tests of other important objectives of a course should lk 


devised. For example, under his directions there have been developed | 


at Ohio State University tests for such outeomes of courses in biology | 
as ability to apply the scientific method, ability to make inferences, 
ability to devise experiments, ete. This procedure tends to shift the 
emphasis in instruction from such relatively narrow objectives as know! 


edge of factual information, so often stressed in such courses, to those 
outcomes that may be more valuable. Certainly it is true that a diagnosis 
based on a mere achievement test of knowledge and skills is not a valid 
one, nor is it penetrating. Other outcomes must be considered. 

The faet of variability of performance must be borne in mind in 
any interpretation that may be made of the results of most of our de- 
tailed diagnostic tests. A common procedure is the analysis of test 
papers by the teacher to determine the specific difficulties of pupils 
For example, the teacher examines a test paper in arithmetic to determin 
the types of examples that were solved incorrectly. After this informa- 
tion has been secured, the teacher assigns practice exercises on similar 
types on the apparent assumption that failure to solve an example ecor- 
rectly is proof that the pupil does not know how to solve similar examples 
or at least needs practice on them. 
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Recent studies we have made here at the University of Minnesota 
ind elsewhere raise questions as to the validity of this procedure. An 
asy way to demonstrate unreliability of this type of diagnosis is to 

ve the pupil more than one example of a given type to solve. In our 
xperimental studies of this point we have given four examples of six 
liferent types in multiplication of fractions to solve. The examples 
vere arranged in random order on the test paper. The pupils were 
riven as much time as they needed to work the examples. No corrections 
vere allowed. The papers were scored in such a way that we were able 
» record whether the pupil missed none, one, two, three, or four examples 
f each of the six types. It was found that in 1101 cases the pupils 


nissed one or more of the four examples in each group of four. In 
43 or 40.2 percent of the cases only one of the four examples was solved 


incorrectly. The other three were solved correctly. This suggests a 
large number of chance or accidental errors. In only 21.6 percent of 
he cases were all four of the examples of a single type solved incor- 
rectly, thus indicating a difficulty that persisted and that was not due 
vholly to chanee. Obviously therefore, it is not at all likely that a valid 
liagnosis of diffieulty or inability in arithmetic can be made on the 
basis of a test containing only one example of a type. At least four 
examples should be used. 
Another illustration of this factor of variability of performance of 
pupils is found in the study of diagnosis of difficulties in English by 
‘illing. Willing gave a series of diagnostic tests in punctuation and 
other phases of English to a large group of pupils. He analyzed these 
papers to diseover the types of errors the various pupils made. Then 
he made a similar analysis of the errors found in their written work 
classes. He eoneluded that the results of the diagnostic tests did 
not furnish a valid basis of diagnosis since the pupils did not make the 
same kinds of mistakes in their usual written work that they made on 
the tests. He also found that there were errors on the regular work 
that did not appear on the test. To insure validity, a test of ability 
to punetuate should adequately sample the range of situations in which 
the skills involved in punctuation may be used. The test should also 
sample the varying reactions of the pupil to the same situation. For 
example, the pupil may be able in one ease to punctuate today but not 
morrow, Some provision must be made for choosing sample situations 
hich inelude the known variables which are most likely to affect the 
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results. This applies to tests in all subjects. At the present time there 
are almost no tests constructed from this point of view. 
To aid in the interpretation of the results of diagnostic tests numerous 


lists of the types of errors made by pupils in spelling, composition, arith. 7 


metic, and other subjects have been laboriously compiled. Knowledge 
of the types of errors pupils make gives some insight into the difficulties 


they encounter. In some eases it has been possible to devise improve. % 
ments in instructional materials which have helped to avert the incidence | 


of these faults. It should be pointed out, however, that relatively litt\ 
information as to the exact causes of these difficulties is available. Fur- 
thermore, very little has been done to determine the seriousness of par. 
ticular faults, their cruciality, which ones may be ignored, or the con- 
ditions of which they are symptoms. Practically nothing has been done 


to determine whether or not there are patterns of errors which would — 


make it possible to classify learners into groups according to their difii- 
culties much as the physician has learned to associate groups of symptoms 


with various illnesses. We have very few tests to locate with any degree | 
of precision or exactness many of the types of faults we have learned | 


to recognize in a vague way through observation of pupil responses 


One may well wonder whether or not it will ever be possible to develop | 
tests of causes of learning difficulty that will be as infallible as the well- | 
known Shick or Dick tests in medicine. The latter test fairly stable | 


conditions, while learning is a growing, changing, cumulative condition. 
It is interesting to note that very few of those who have made such 


painstaking studies of pupil errors have investigated the extent to which | 
a particular fault detected in the pupil's rk persists in his work. | 


Unless an error persists it may be merely 4 chenee one. The fact that 
a pupil misses four examples of a given type is no assurance that he 
misses them all for the same reason, although our studies show that in 
such cases there is usually present a constant error indicating a genera! 
difficulty. The interesting thing we find is that such constant errors 
are usually associated with other errors of a highly variable type. Ap- 
parently, pupils make a large number of random errors of a type that 
is difficult to explain in some cases, except on the grounds of sheer 
ignorance or inability to do the work. That this finding is probably 
true for other subjects than arithmetic was well illustrated in the find- 
ings of Willing, previously described. At present we are extending 
these studics of persistence of error into other fields. We are also stud. 
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ing the effect of tests constructed in various ways on the persistence of 
errors by pupils. These studies have not yet progressed far enough 
to make results available. 

At present we know little concerning the effect various kinds of 
motivation may have on the reduction or increase in particular kinds 
of errors by pupils. We know that positive forms of motivation greatly 
influence the rate of learning. It is conceivable that many of the types 
of errors that we find in the detailed lists would not be found at all if 
we could devise methods of controlling the efforts made by pupils on 
test exercises. Many of the errors are undoubtedly due to what we call 
mere carelessness or lack of interest. Under such conditions any diag- 
nosis may be wholly invalid. Without the codperation of the learner 
test results may give a picture that is wholly false. Much more needs 
to be done to standardize the conditions under which diagnostic studies 
are made, so that we may study more definitely the factors that influence 
pupil performance and contribute directly to the incidence of error. 

The question may also be raised as to the extent to which errors and 
learning difficulties will disappear in the natural course of events, due 
to such faetors as maturity, biological growth, routine teaching, and 
developing insight on the part of the learner. If faults disappear in 
the natural course of events without any diagnosis or special types of 
remedial attention problems of instruction are greatly simplified. If 
they persist, the need of diagnostic measures is obvious. It may be 
assumed that we shall greatly reduce learning difficulties as we perfect 
instructional procedures and materials. That we shall be able to eliminate 
such difficulties entirely is wholly unlikely due to our lack of knowledge 
of the various factors that condition learning. A simple technique we 
are using to study the relation of such factors as growth and routine 
teaching to persistence of errors in arithmetic is to analyze the work 
of pupils on identical tests repeated at varying intervals of time, such 
as an hour, a day, a week, two weeks, ete., to determine the extent to 
which diffieulties disappear. 

Bio-chemistry shows that the functioning of the internal secretion 
mechanism has a direct bearing on maladjustments of many kinds, both 
physical and mental. Sinee learning is attended by some modification 
in the nervous mechanism it seems likely that in many instances learning 
iust be conditioned by the various glandular disturbances and imbalances 
that we know exist. For-example, it is known that stuttering is often 
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associated with thyroid deficiency. At present we know very little con- 
cerning the relationship of glandular functioning and learning. This 
whole field merits extended research. For example, motivation which 
is recognized as one of the vital elements in learning is intimately related 
to emotion which is in turn controlled by glandular functioning. Many 
interesting hypotheses on the bearing of this fact on instruction could 
be proposed. For example, the variability of human performance may 
be intimately associated with chemical changes, for instance in the 
blood, or may be due to subtle forms of reaction to unknown forms 
of stimuli. If bio-chemists and those interested in learning problems 
could be brought together in the study of educational problems it seems 
as though there might result a whole series of findings of vital importance 
in diagnosis. This type of research would be especially helpful in getting 
at some of the causes of inability to learn. We have been too much con- 
cerned with the mere manifestations of difficulty through external symp- 
toms. The time may be here when we shall shift to the definite attack 
on their causes. Much of our remedial work is ineffective since we know 
so little concerning causes. 

If one serutinizes the literature closely one can find here and there 
evidence that we are beginning to make definite attacks on the problem 
of diseovering the causes of learning difficulty. We have long associated 
so-called poor eye-movements with reading disability. Often poor eye- 
movements have been thought to be the cause of poor reading. The 
remedial work to overcome this fault has been directed toward the im- 
provement of eye-movement. Recent research suggests that certain types 
of faulty eye-movements should not be regarded as the cause but rather 
as a symptom of poor reading. Eames and Selzer have found that poor 
reading is definitely associated with a physical condition called muscular 
imbalance of the eye, technically termed ‘*exophoria’’ or ‘‘heteropheria.’”’ 
Although compensation can clear vision, under these conditions an ex- 
cessive amount of nervous energy may be required, leading to fatigue. 
As a consequence fluctuation occurs, which tends to increase fatigue. 
Faulty eve movements may be habits conditioned by this wavering, hence 
due to physical eonditions, which would have to be corrected before 
correct reading eye movements could be developed. 

Another interesting finding showing the relation of physical faetors 
to learning is the apparently well established fact that lateral handedness 


or dominance seems to be associated with reversals in reading. Dear- 
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born reports that in some cases of reversals, if the pupil learns to read 
and write at the same time as is usually the case, the difficulty is aggra- 
vated. He reports the practice used in some schools of delaying the 
teaching of writing to first grade pupils who are left handed until they 
are well advaneed in reading. This would tend to check the confusion 
of habits. To the casual observer, lateral dominance and disability in 
reading seem to be far removed one from the other, yet there may be 
here a subtle relationship of great significance in diagnosis. 

Dearborn also reports that the tendency of poor readers to alter 
the order of letters in parts of a word, as reading ‘‘framing’’ for 
‘‘farming’’ is associated with deviations from the usual conditions of 
lateral dominance, such as ambidexterity of hand and eye, change of 
handedness and eyedness, and the combination of right handedness and 
left eyedness or the reverse. It is not known whether there is here a 
causal relationship. If there is, it would seem almest futile to direct 
corrective efforts to work removing an apparent reading difficulty when 
it is not due to reading inability as such but to a physical condition or 
deficiency which conditions it. The errors due to reversals may be con- 
sidered to be the consequence of conditions in the physical mechanism 
beyond the pupil’s control. 

Knight and Ford recently reported the results of an analysis of the 
errors found on particular multiplication combinations as affected by 
the depth to which particular combinations are embedded in an example. 
For instance, the combination 8 times 9 is embedded more deeply in 
the example 974 times 86 than in the example 749 times 68. In one 
case the combination is the last one while in the other it is the first one. 
Knight and Ford found that the more deeply the combination was em- 
bedded in the example the more likely pupils were to make an error 
in working it. Thus a pupil may know a combination in isolation but 
fail to give it correctly in a long example. The authors believe that 
‘This difficulty may be thought of as a temporary lapse in, or degenera- 
tion of, ability within a segment of work. Thus in addition to such 
factors as subject matter, age, motive, sex, previous fatigue, fluctuations 
in health, and the like much of error may be the direct and protective 
outeome of a disregard on the part of the pupil or teacher for the 
periodicity of output of energy during the working period, even if it 
may be of only a short duration.’’ The cause of errors cannot be fatigue 
since in succeeding examples the errors on the same combinations do 
not reoceur. 
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Many other illustrations might be presented of factors that suggest 
the difficulty there may be in making a valid diagnosis of causes on 
inability of pupils to learn or of the errors they make. As Knight and 
Ford say, ‘‘We badly need an adequate theory of the nature of error. 
It is apparent that much of the present thinking about error assumes 
that error is a much simpler phenomenon than it is. Errors may not be 
a single thing in their nature. Treating all errors alike is analogous 
to treating all fevers alike—a purely makeshift and palliative futility. 
Thus, the therapy error due to temporary lapse is not the therapy for 
actual ignorarice. Much of our treatment of error, be it ever so heroie, 
is nevertheless superficial and unsuccessful because it is based on too 
little understanding of the psychological nature of the error and the 
processes leading to it.”’ 

In the forthcoming yearbook it is proposed to study the problems of 
diagnosis from many angles. This ean readily be observed by an analysis 
of the variety of interests represented on the committee. The following 
are the personnel: G. T. Buswell, University of Chicago; Ralph Tyler, 
Ohio State University; Willard Olson, University of Michigan; Lee 
Travis, State University of lowa; P. T. Rankin, Detroit, Michigan; J. L. 
Stenquist, Baltimore, Maryland; and Leo J. Brueckner, University of 
Minnesota, Chairman. The committee plans to ask the codperation of 
specialists in all fields in the preparation of what it hopes will be an 
authoritative statement of the present status of diagnosis, practical 
methods of applying valid diagnostic techniques, the difficulties and 
limitations of diagnosis of learning problems, and needed research. The 
writer suggests that anyone who is at work on some piece of research 
that seems to bear on any of the problems herein outlined or others of a 
similar nature get in touch with the members of the committee who are 
especially interested in the particular field. It is the desire of the eom- 
mittee to make this yearbook, in a real sense, a codperative undertaking. 
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AN INTEREST INVENTORY FOR HIGH SCHOOL 
PERSONNEL WORK 
GERTRUDE HILDRETH 
Lincoln School of Teachers College 


New York City 

THE popularity of the inventory as a means of studying personality 
traits is indieated by the inereasing frequency with which this technique 
is employed in personnel work. Casual observation is recognized as in- 
adequate for the study of adolescent problems. Successful adjustment 
of the pupil to the school situation requires that teachers and advisors 
have adequate information concerning the child’s interests and prefer- 
ences with respect to a large number of activities and fields of interest, 
companions, sports, social activities, reading, study habits and school 
subjeets and vocational preferences. Knowledge of the child’s habitual 
modes of thinking and acting as well as his own evaluation of himself 
are essential to the full understanding of the child and his probiems. 
Without such information, teaching and guidance work may be not only 
ineffectual but actually harmful in its consequences. 

ALTERNATIVE METHODS OF STUDYING PUPIL INTERESTS 

There are several alternative methods of obtaining pupil interest and 
attitude data. One method is that of personal interview with the pupil. 
Another is observation of the individual while he is engaged in a variety 
of aetivities in and out of school. A third method is that of asking the 
pupil to record on a suitably arranged blank statements concerning his 
activities and preferences. If there are many cases to study or if in- 
formation for a large proportion of pupils is required, the first method, 
used exclusively, is almost out of the question unless the school has a 
large staff for guidanee work. Aside from the amount of time consumed 
there are the additional problems of pupil reticence during interviews 
and the recording of results in objective form, uncolored by the prefer- 
enees and biases of the interviewer. 

The second method is even more time consuming and just as de- 
pendent upon highly trained observers for reliable work. It avoids the 
faetor of embarrassment to the pupil, provided he does not discover that 
he is being observed. Either of the two methods represents a highly 
specialized activity. The third method, that of having pupils record in 
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some objective fashion information concerning their personality traits, 
interests and habits, though not in all respects free from objectionable 
features from the standpoint of reliability and validity, nevertheless is a 
time saver, gives the pupil a part in the undertaking, and affords perma- 
nent records in convenient form for filing. When time and adequate per- 
sonnel staff are available such records may profitably be supplemented 
by data obtained through methods one and two. <A record blank filled 
out by the pupil constitutes a natural starting point for an interview 
since it releases tension on the part of the child by centering attention 
on his paper rather than on himself. The complete ‘‘blocking’’ which 
even the expert interviewer encounters when he puts such questions as 
‘*Now tell me which subjects you have most difficulty with’’ is in decided 
contrast to the situation when the interviewer can say ‘‘ Now, let’s see 
what you wrote down about your school work. Here you have the names 
of the subjeets vou like best, and here the ones you do not like so well.’’ 
At this point the pupil will usually volunteer more information about 
his success in school work. 

The objection to the questionnaire method when the record is made 
by the child and is unchecked by other methods is that the child may 
he unable to give an accurate picture of himself with respect to the 
traits in question or he may intentionally falsify his record to make it 
fit the picture he wants his teachers and advisors to have of him. Other 
things being equal, the pupil who is older and more mature mentally 
is more capable of giving an accurate picture of his personality. Whether, 
even though he is more capable of giving an accurate picture, he is more 
apt to do so, depends upon several factors: the morale of the school and 
the sportsmanship of the pupils, the use that pupils feel is to be made 
of their records, the purposes for which the information is being col- 
lected, the pupils’ attitude toward the person who is directing the study, 
and the extent to which pupils are momentarily influenced by companions 
or ‘‘héroes’’ among their classmates. Results will be more satisfactory 
if pupils are convineed that they are to be helped in their problems 
rather than to feel that someone is trying to ‘‘get the goods’’ on- them. 
The request that pupils fill out interest inventories should come from 
a person with whom the pupils are in satisfactory rapport. 

DESCRIPTION OF THE INVENTORY RECORD BLANK 


The inventory blanks to be described here have been used with satis- 
factory results at the Lincoln School of Teachers College, Columbia Uni- 
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versity, in obtaining information from pupils of high-school age for 
personnel work. The deseription will be confined to the use of the test 
blank itself rather than to the contribution to adolescent psychology 
of the facets discovered. For this latter interesting and pertinent topic 
separate treatment is necessary.* 

The material given to the pupil consists of two parts: a single sheet 
on which he is to record his interests and preferences in a number of 
categories and a cheek-list which contains an extensive list of headings 
under each category. Only a few sample items in each category of the 
check-list are given here. The two blanks are given to the pupil with 
the statement that the school wishes to become better acquainted with 
him, and in order to do so would like to have him tell about some of 
his activities and interests. Directions for filling out the blank are then 
given. Copies of these blanks are shown below. 

If the examiner wishes, the accompanying List of Activities and 
Interests need not be used. Instead, pupils are simply asked to write 
down the names of their preferred activities, reading material and the 
like, with only a general suggestion as to the type of information required 
in each category. One objection that has been raised to a check list of 
items is that pupils may record as their choice items that might otherwise 
never have oeeurred to them. On the other hand, since recognition is 
easier, psychologically, than recall, the use of the check sheet facilitates 
response. With no assistance to his memory the pupil’s response becomes 
impractically slow, and he may be totally unable to recall his interest 
in a particular category, as for example the name of the magazine he 
most enjoys reading. 

To the contrary, it may be argued that if the child cannot recall the 
item, then it cannot represent a real or abiding interest or preference. 
Research is clearly needed at this point to determine which method or 
combination of methods is most practical and at the same time most trust- 
worthy. In the case of younger children there is danger of fatigue if 
pupils are requested to read through the long lists of items before 
recording their responses. In such cases the teacher or investigator 


might read quickly sample items chosen at random from the list under 


each category, and then ask pupils to list their preferences. 


*See Hildreth, Gertrude. ‘‘ Adolescent Interests and Abilities,’’ Journal” of 
frenetic Psychology, June, 1933. 
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PUPIL’S INFORMATION BLANK I 
I. ACTIVITIES 
Those liked 
’ 
. GAMES—SPORTS x 
: Those liked Those disliked 
y Ree, MCE AN A> Re a , ene eee” Rae ese eS 
, _p anne ee = Gee tS SS 2. 
3 ER Ae eee. oe aT 
: 111. SCHOOL SUBJECTS (First, list here by number all subjeets in the list that 
you have studied during the past two years) ...........----....2:..-s.scesesseeennennseeeeenennssnseases 
Those liked Those disliked 
De, | Saiinacikectnsvitdicantuaniideieiecuhaesneeaaane | ERE See eee Ee aes Roadie SO 
EP EO... RRR 7a el , RP Cee Se ee eee 
, I’ seesicipaepcosteaalsiadieapadlagadie Niteseiaieiia eee thal Dh, “wbesstadacduaicbenshicsasnatiseann eatin. 
Xl 
IV. TYPES OF BOOKS 
Those liked Those disliked 
) Pere cs TS UR ee | RE ewe + eee Pe. 
5 Be -nscenonmmincenapasternnisenseswensiatidaansisteatin Tih = .ccitnndstee atavincendcebicndeeeiate en 
t i, «reese A elaieaeta ares 
V. BOOKS READ DURING PAST VIL. MAGAZINES PREFERRED 
TWO YEARS 1 
: Deen eneeeeeeeneeee a DRI DOs a ee Dire 
A SII = BI Uae See 7 be u 
) * 3. Oe ee ee eee of i 
; a meinen cee ae: choi 
, i. « unde 
hesi! 
VIL. NEWSPAPERS READ VILL. OCCUPATIONS YOU MIGHT to ¢g 
1 LIKE enjo 
si | ‘eonsesinelcestielatdianasieeiaatasentammddiedal a % 
°. Ts Pitas csiaichtetthsti<cesthdnnckecsimaatldacaiibaan mr 
i paahelnteicndipsinanapsendbtchenilipilagiclidtimpedsae you 
Bie oe Or time 
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IX. PEOPLE YOU LIKE TO BE WITH IN YOUR FREE TIME 


» oa Those liked Those disliked 
= Re it ET Se a (Eg eS esa SS Se! ee 
Se |. ehilicddeditisetnal adtanhaebanpedidininhnniocn ” cdansnadiiasadabaienaiatcnidiketmadicniainah minha 
X. SCHOOL PREFERENCE AFTER HIGH SCHOOL.................--.-.-.-..-.-22.-.-200...2.02- 


\l, PERSONAL CHARACTERISTICS 


Those that deseribe you Those that do not deseribe you 

1 a ea ae 

Be ceecgtenns—ehsiiecleniscascanipe teh aint Seteigs ae SO Lae ae 
soos Ih = evlsocnrnndlhialih cainepeiansainepepedion ES ae ae ee 
ne . _—— is. ib ccentes ional ieigeestemisbatncbnaineiteasds 

Oe spapstibaclands Gichcdbasennisndetiontsecemimeatiids A a ee ee 

Tio: incl Mapittes tiie teinescnpbigtaniciaianstemeas lk... sicbhsnduainibeiccabatiplacteitinnsinvenianaiat’ 

Gal, "isi tresnehsioesettinastnsnseiilas si oneicaataieaiieats Re. ceiarlietincbienphniaiciinnnmentons 

a <ceesiscaiadastialebecenbhiheliaietapatapbenen in hs asaestinenabdnwnsamnakiniedititnndnds 

_ see eS Re ee ee ie tacecaeesdiceellcnacuk diastase ion aeatianscbenesens 

BD, s.cactinatnananshbedatigntnniiaieiaibinnbland DINE. cicscicteeteatnssruapiibndinhnioasdmensisssindjece 


All. If you could have your wish for the thing you desire most what would it be? 


LIST OF ACTIVITIES AND INTERESTS 
(Referred to as the check list) 


Directions: DO NOT WRITE ANYTHING ON THIS BOOKLET. This list is to 
be used as an aid in filling out your INFORMATION BLANK. Read over the list 
of items in the LIST OF ACTIVITIES and INTERESTS, decide on your first 
choice, write its name and number on the first line of your INFORMATION BLANK 
under the topie Activities. Then write the number of your second choice. Do not 
hesitate to write down on your INFORMATION BLANK any information you wish 
to give even though it may not be given in the typed list. For example, if you 
enjoy reading most a magazine not mentioned here, be sure to list that magazine 
as your first choice. Do not feel that you must give information simply because 
the topic is ineluded in the blank. If you are not going to school after high school, 
you would of course leave out information on this item. Do not spend too much 
time thinking about any item or topic. 
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. Watching athletic 


events 


. Looking up information 
. Taking care of children 
. Playing piano 

. Working around 


machinery 


Anagrams 


. Baseball 
. Basketball - 
. Bridge 


. Algebra 
. American History 
. Chemistry 


Civies 


. Commercial Subjects 


. Encyclopedias and 


Books of Knowledge 


. Stories of home and 


school life 


. Nature and animal 


stories 


I, ACTIVITIES 
22. 
. Inventing things 
26. Visiting museums 


30. Attending movies 64. 
34. Bieyele riding 69. 
37. Going to parties 72. 
49. Studying 
Il. GAMES—SPORTS 

14. Crap Games 33. 
18. Football 34, 
21. Hockey 37. 


23. Ping Pong 
Ill. SCHOOL SUBJECTS 


14. English 26. 
17. French 29. 
18. General Science 32. 
23. Household Arts, Cook- 36. 
ing, ete. 43. 
IV. TYPES OF BOOKS 
5. Novels and love stories 17. 
9. Adventure stories 19. 
11. Mystery stories 21 
15. Classics 33 
16. History 


. Driving an automobile 51. 
52. 
61. 
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Hating ‘‘dates’’ 
House work 
Canoeing 
Reading 
Swimming 
Wooderaft 


Tennis 
Track 
Wrestling 


Latin 
Musie—Singing 
Physical Education 
Shop Work 

Zoology 


Science 
Sports 


. Humor 
. Arts 


V. BOOKS READ DURING PAST TWO YEARS 
List them on INFORMATION BLANK 
VI. MAGAZINES PREFERRED 


. American 

. Century 

. Harpers 

. Judge 

. Liberty 

. Life 

. Outlook 

. Red Book 

. American Boy 


29. Boy Mechanic 65. 
32. Cosmopolitan 78. 
36. Girl Scouts 79. 
37. Golden Book 82. 
40. New Yorker 91, 
49. True Stories 97. 
52. American Girl 

56. Atlantie Monthly 98. 
58. College Humor 


VII. NEWSPAPERS READ 


Literary Digest 

Detective Stories 

Good Housekeeping 

Ladies Home Journal 

Saturday Evening Post 

Woman’s Home 
Companion 

Youth’s Companion 


List them on the INFORMATION BLANK 
VIII, OCCUPATIONS YOU MIGHT LIKE 


. Aecountant 

. Aetor or Actress 
. Architect 

. Artist 

. Athletic Director 
. Author 


11. Automobile Repairman 29. Chemist 

13, Aviator 30, Civil Engineer 
14. Baker 32. College Professor 
15. Banker 40, Dentist 

26. Carpenter 41. Deteetive 

28. Chauffeur 43. Doetor 
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44. Dressmaker 87. Milliner 110. Private Secretary 
45. Editor 88. Miner 116. Real Estate Salesman 
49. Factory Worker 91. Motion Picture Director 117. Reporter 
55. Football Coach 92. Musician 121. School Teacher 
58. Governess 95. Nurse 122. Scientific Research 
60. Hairdresser 96. Office Clerk Worker 
62. Homemaker 101. Photographer 127. Social Worker 
69. Janitor 102. Playground Director 128. Soldier or Sailor 
70. Jazz Orchestra Player 104. Poet 131. Stenographer or 
74. Lawyer or Judge 105. Policeman Typist 
75. Librarian 106. Politician 136. Tailor 
76. Life Guard 107. Preacher or Priest 142. Undertaker 
86. Merchant 108, Plumber 143. Waiter or Waitress 
IX. PEOPLE YOU LIKE TO BE WITH IN YOUR FREE TIME 
. Older boys 5. Boys your own age 9. Other adults 
2. Younger boys 6. Girls your own age 10. No companions 
3. Older girls 7. Mother 11. Little children 
4. Younger girls 8. Father 12. Teachers 
X. SCHOOL PREFERENCE AFTER HIGH SCHOOL 
1. Kindergarten Training School 13. State University 
2. School of Commerce or Business 14. State Agricultural School 
School 15. State Engineering School 
3. Musie School 16. Normal School 
4. Boarding School 17. Teachers College 
5. Dramatic School 18. Art School 
6. Large Men’s College or University 19. School of Physical Education 
7. Large Women’s College or University 20, Theological Seminary 
8. Medical School 21. Trade School 
9. Law School 22. Large Coeducational College 
10. Dental School 23. Small Coedueational College 
11. Junior College 24. Small Women’s College 
12. Aviation School 25. Small Men’s College 
XI. SELECT THE PERSONAL CHARACTERISTICS THAT DESCRIBE YOU 
1, Happy most of the time 46. Plan ahead 
4. Quick tempered 49. Dislike to put things away when 
6. Like quiet activities through 
10. Afraid of many things 50. Fond of school work and activities 
11. Dislike parties 53. Have difficulty with school teachers 
mn 14. Interested in people and their affairs 55. Considered a leader in school 
15. Able to work well with others activities 
18. Considered a good sport 56. Sleep well 
21. Have good taste in dress, decorations 58. Have many headaches 
25. Have skill in art, music, writing 61. Cannot eat many vegetables 
26. Follow directions easily 64. Considered a good dancer or skater 
30. Broadminded 65, Enjoy being away from home 
34. Good at mechanical things 67. Have understanding and sympathetic 
37. Slow but sure thinker parents 
41. Usually on time 69. Dislike to do what parents ask 
3. Hate to work 70. Have a better than average home 
USE OF THE INVENTORY FOR GROUP OR INDIVIDUAL EXAMINATION 
The inventory is equally suitable for either group or individual ex- 
amining. In group examining the administrator should arrange the 
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situation so that pupils cannot communicate with each other while 
filling out the blanks. On one oceasion a boy remarked to his eom- 
panions, in a stage whisper, that in the list of vocations the oceupation 
of ‘‘husband’’ and ‘‘father’’ was missing. The result was, in that 
particular group of papers, decidedly more listing of ‘‘husband’’ or 
‘*father’’ as the preferred occupation than chance would allow. In 
order to save time the examiner may request that instead of pupils 
writing out in full the names of their preferences, they indicate them 
by the numbers placed before the items in the check list. Thirty minutes 
is usually an adequate time allowance. 

In individual examining, when the material is to be used in eon- 
junction with other tests, our procedure is to give intelligence or achieve- 
ment tests first, to follow these with the inventory described here, and 
in turn to follow the inventory with an interview starting from the 
information furnished by the inventory. Complete case work which 
will not be deseribed here requires, necessarily, much further investiga- 
tion than the outline of pupil study given here, but all of the informa- 
tion obtained by these methods may properly be considered part of a 
case study. 

When the questionnaire follows standard tests the pupil is inclined to 
accept it impersonally as just ‘‘so much more’’ of the same thing. As 
he proceeds and finds that it is unlike the test he has just been having, 
he continues, often with considerable pride and gusto to furnish in- 
formation about himself. He does not realize that later he will be 
interviewed concerning its contents, nor is he conscious of the fact that 
he is often ‘‘giving himself away’’ by his responses. 


PRACTICAL USES OF INFORMATION FURNISHED BY THE INVENTORY 


The advantages to the school in having more complete information 
of individual pupils such as the inventory deseribed here provides are 
manifold. More pertinent advice can be given concerning the selection 
of courses, vocational guidance, choice of college, the arrangement of 
sports, and social and aetivity programs. The data are invaluable in 
talks with parents, in making individual assignments, in classifying 
pupils, in coéperating with health services, in arranging the pupil’s 
study program, and in ease study of problem pupils. 

In order to interpret the responses of any one individual pupil it is 
highly desirable to have at hand data for a large unselected sample 
of the population of pupils of the same age or grade. Using these 
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‘‘norms’’ as reference points, individual idiosyncrasies or abnormalities 
may readily be determined. 


REFERENCE LIST OF INTEREST QUESTIONNAIRES AND PERSONALITY 
RATING SCALES 


There are many variations of the interview and questionnaire method 
of determining interests and habits of high school and college students 
and workers in industry. For the benefit of the reader who wishes more 
information about such materials some of the most extensively used and 
practical devices for work with high-school pupils are listed here. Other 
adaptations are possible which these methods suggest. 


Interest Analysis—Form A. New York City: Association Press, 1931. 

Brainard, P. P. Specific Interest Inventory For Boys—For Girls. 
New York City: Psychological Corporation, 1932. 

Garretson, O. K., and Symonds, P. M. Interest Questionnaire for 
High School Students. New York City: Bureau of Publications, Teach- 
ers College, Columbia University, 1930-31. 

Freyd, M. Occupational Interest Blanks. Chicago: C. H. Stoelting 
and Company, 1922. . 

Hepner, H. W. Vocational Interest Quotient Booklets. New York 
City: Psychological Corporation, 1931. 

Jenson, D. W. Interest Questionnaires: Genetie Studies of Genius, 
Volume III. Stanford University, California: Stanford University 
Press, 1930. 

Kelley, T. L. Interest Tests: ‘‘ Educational Guidance—an Experi- 
mental Study in the Analysis and Prediction of Ability of High School 
Boys.’’ Contributions to Edueation, No. 71. New York City: Bureau 
of Publications, Teachers College, Columbia University, 1914. 

King, L. H. Personnel Record and Interest Test: ‘‘Mental and In- 
terest Tests.’’ Contributions to Education, No. 444. New York City: 
Burean of Publications, Teachers College, Columbia University, 1931. 

Miner, J. B. Analysis of Work Interest Blank. Chicago: C. H. 
Stoelting and Company. 

Minnesota Interests Questionnaire. Minneapolis: University of Min- 
nesota Press, 1930. 

Strong, E. K. Vocational Interest Blank. Stanford University, 
California: Stanford University Press, 1930. 

Wyman, J. B. ‘‘Tests of Intellectual, Social and Activity Interests.’’ 
Genetic Studies of Genius, Volume I. Stanford University, California: 
Stanford University Press, 1925, pages 455-483. 

The most widely used personality trait inventories are the following: 

Bernreuter, R. G. The Personality Inventory. Stanford University, 
California: Stanford University Press, 1931. 

Thurstone, L. L., and T. G. Personality Schedule. Chicago: Uni- 
versity of Chicago Press, 1928. 

Woodworth, R. S., and Mathews, E. Questionnaire. Chicago: C. H. 
Stoelting and Company, 1923. 

















. 


IMPROVING THE MEASURING QUALITIES OF AN 
ESSAY EXAMINATION 


VERNER MARTIN SIMS 
University of Alabama 


THE PROBLEM 


THe great variation found in the werks assigned by different sup- 
posedly competent readers to the traditional or essay examination may 
be due to: (1) disagreement as to what is being measured, disagreement 
as to whether one shall consider content, organization, use of English, 
neatness, ete.; (2) disagreement as to the contribution of the various 
elements to the total, disagreement as to the weighting of the questions 
and the elements within a question as well as to how much such factors 
as those mentioned above should contribute; (3) differences in the stand- 
ards of grading, differences among systems and among teachers using the 
same system; and (4) the subjectivity of the materials being marked. 
The first eause of variation is not inherent in the nature of the instru- 
ment but is the result of disagreement as to the ends of instruction or as 
to the function of the particular examination; the second is a common 
one in human measurement, where our units are never equal, but it is 
subject to certain control, if by nothing more than arbitrary agreement 
as to the weighting; and the third, not a matter of measurement but of 
the interpretation of the measurement, is due to an attempt on the part 
of the reader to express performance in terms of some real or imaginary, 
and wholly arbitrary, grading system. Theoretically, then, these three 
factors may be considered as extraneous sources of error, and the ultimate 
value of the essay examination can be determined only after we have de- 
veloped means of controlling them or have demonstrated that they are 
beyond control. 

Kelly .(4*, p. 83) and Ruch and Fauber (7, pp. 102-106) have shown 
that the use of certain scoring rules, which would tend to reduce disa- 
greement as to what is being measured and as to the contribution of the 
various elements to the total, will greatly reduce the variations among 
readers. Ruch (7, p. 105) says, ‘‘. . . the variability . . . may be eut at 
least in half by the use of carefully laid-down seoring rules.’’ Sims (12) 


*Refers to list of references at the end of this article. 
20 
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found that by considering the reader’s marks as scores (raw units of 
measurement) and converting them to grades (standard units in the sense 
of expressing position in a group) the variability from reader to reader 
was reduced more than one-half. 

Will the combination of these two procedures still further improve 
the measurement obtained by the essay examination? It is the purpose 
of this paper to evaluate an essay examination which was scored with 
rules and the marks then transmuted to grades. 


THE EXAMINATION 


An hour essay examination, consisting of ten questions based upon a 
unit in General Psychology, was given to a class of 33 students who had 
just completed the unit of work. The examination, a bona fide one, was to 
be combined with other measures to determine the preliminary grade for 
the semester. In an earlier study Sims (11) has pointed out that the 
questions commonly used in essay examinations may be classified as ob- 
jective (simple-reeall or short-answer) and discussion (eriticize, discuss, 
explain, interpret, trace, ete.) types, and that about 60 percent of the 
questions are of the objective type. This examination was a typical one 
in the sense that it was made up of six objective and four discussion ques- 
tions. The following questions are typical of the two types: (objective) 
‘What are the chief divisions of the psychological field as given by 
Dashiell? Identify the nature of each with a sentence. . Mention the 
name of one man prominently associated with each field.’’ (discussion) 
‘*Diseuss the significance of psychology for three occupational groups.’’ 

The students were assigned numbers to be used in identifying the 
papers, and were instructed to answer each question on a separate sheet 
of paper. They were cautioned to so distribute their time as to be able 
to answer all questions in the allotted time. All students managed to 
complete the examination, although a few of them were rushed at the end. 


SCORING AND GRADING 

Eight readers marked the set of 33 papers. The readers were three 
instructors, three ‘readers,’ and two students, in the Department of Psy- 
chology, College of Edueation, University of Alabama. The regular test- 
ing program in General Psychology consists of a series of codéperatively 
prepared objective examinations, so that none of the readers had had 
special practice in marking essay examinations in this subject. The in- 
structors were, of course, familiar with the marking of essay examina- 
tions and two of the ‘readers’ had been reading essay papers in Educa- 
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tiondl Psychology. The other readers had had practically no experience 
with them. In seoring the papers all readers used the same scoring rules, 
and each reader’s marks were afterward converted to grades by a uni- 
form procedure. 

The scoring rules involved general instructions to consider content 
only in the objective questions and content and organization in the dis- 
cussion questions and then specifie directions were provided for scoring 
the two types of questions. For the objective questions a key was fur- 
nished which gave the correct answer for simple-recall and acceptable 
answers for short-answer questions (the text being the authority), and 
arbitrarily assigned score values of one point for simple-reeall items and 
two points for entirely satisfactory or one point for partially satisfactory 
short-answer items. A modification ©f a rating technique which the 
writer has described and evaluated in a previous paper (10) was used 
for scoring the discussion questions. Each question was scored by sorting 


_ the 33 answers on the basis of merit into five groups, a normal distribu- 


tion being assumed and conformed to rather rigidly. The instructions 

given the readers were: 

1. Read the section or sections in the text devoted to the question. 

(References were furnished.) 

Quickly read through the answer given to the question by every 

student. 

3. Go back and sort the answers on the basis of merit into five groups 
as follows: (conform rather closely to the numbers suggested for 
each group) (a) the 3 or 4 very best papers, (b) the 6 or 7 su- 
perior papers, (¢) the 12 to 15 average papers, (d) the 6 or 7 
inferior papers, (e) the 3 or 4 very worst papers. 

4. Give a score of 10, 7, 5, 3, and 0 points, respectively, to the var- 


to 


ious groups. 


The readers reported the score on every question for each paper. To 
determine the total score for a paper the questions were considered of 
equal value and were each assigned a score value of ten points. The scor- 
ing method used for the discussion questions automatically weighted them 
equally and gave this score value. Sinee the number of items in the sev- 
eral objective questions varied, it was necessary to express the score made 
as a cractional part of ten; which was done simply by dividing the score 
made by the possible score for the question and multiplying by ten. 

Each reader’s scores for the set of papers were converted to grades, 
with 70 percent as a passing grade, by a method proposed elsewhere by 
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this writer (9). This procedure involved locating the passing score at 

114 standard deviations and then graphing the relationship between 
scores and grades, assuming that the passing score corresponds to the 
passing grade and the maximum possible score corresponds to the maxi- 
mum possible grade. The steps in the process were: 

1. Locate the lowest passing score. (—11% standard deviations. ) 

2. With the lowest passing score as the origin, lay off in equal steps 
on the vertical axis of a graph the possible scores. 

3. With the lowest passing grade as the origin, lay off on the hori- 
zontal axis of this graph distances corresponding to the pos- 
sible grades. 

4. Draw a diagonal through the origin and the point corresponding 
to the maximum possible score and the maximum possible grade. 
To find the grade of a particular score: Read across to the diag- 

onal and up or down to the percentage line. 


In order to evaluate the examination when so seored and graded we 
determined: (1) the variation from reader to reader in the grades 
assigned the respective papers; (2) the objectivity as shown by (a) the 
correlation between each reader and the average of all readers, and (b) 
the correlation between each reader and every other reader; (3) the re- 
liability; and (4) the correlations between this examination and a new- 
type test covering the same subject matter. Evidence on the last three 
points was secured not only for the total examination but also for the two 
types of questions, objective and discussion. 


VARIABILITY OF THE GRADES 

The great variability which is usually found when a number of read- 
ers mark the same papers needs no comment here. To what extent has 
our treatment reduced this variability? Table I shows the grades given 
by each of the eight readers, the range from the highest to the lowest 
mark given, and the probable error, .6745 standard deviations (3, p. 211), 
for each of the 33 papers.’ 

The average range for the 33 papers was 4.4 points, the maximum 
range for any paper was 7 points, three papers having this range and 
four of the papers having a range of but 2 points. The average probable 
error for the 33 papers was 1.0 points, the maximum probable error being 

* The first three readers in this table (and in other tables reporting the several 


readers) were the instructors, but there was no consistent difference between the marks 
of the instructors and the other readers so no further attention will be given to them. 
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TABLE I 
SHOWING GRADES GIVEN BY 8 READERS TO A Ser oF 33 EXAMINATION PAPERS WHEN 


’ " . 

ScorRED WITH RULES AND THEN CONVERTED TO GRADES . 

Paper Reader Range P.E 
I ; 4 ) 6 7 a 

l ua a6 u O4 o4 93 o4 92 : 7 

} td or a7 a6 a8 87 a5 86 7 1.6 

a7 28 . <6 a4 a0 ao 38 6 1.3 
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a7 a6 a7 a7 87 RG 87 { 6 

6 . a6 a5 a6 aS So x4 ss i 1.0 

a5 a6 aS a5 6 a5 R4 a6 2 4 

. ~ a4 ~ 87 a4 a4 a7 ” 1.0 

) 5 a4 a3 x3 a BH s4 s4 2 7 

| ~ a a6 0 ee aS aS RO 1 1.1 

11 2 » a0 a0 5 a0 a1 x6 " s 
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i4 82 s x4 ee a2 a3 . i q 

1 2 a 1 78 x] Bo ; J 1.2 

if } x1 78 x. 70 ay ) J 7 15 

l } s ~ mi a1 a0 } RO a 

T a4 To Ro 79 21 32 x0 76 7 L.5 

19 al | = at 7 5 80 i 1.1 

79 82 i8 79 7¥ s1 a0 79 4 9 

} ) Pe 7a 79 78 80 Q 79 i 7 

’ ~ 6 i7 78 76 77 78 4 9 

77 " - 73 77 78 RI 6 6 

i s1 77 8 74 78 78 6 75 7 1.6 

7¢ 7 7 73 73 76 76 i 1.2 

76 7 i 74 75 7 75 4 9 

4 l 72 i4 74 74 2 4 1.0 

3 6u 7 73 74 7 74 6 ot) 

’ I 7 1 i4 70 73 70 7 4 1.2 

69 71 69 69 71 69 72 ) 9 

] Hu 6a ) 71 6a 71 71 490 ° 9 

69 69 68 72 69 69 64 71 4 s 

t f f 68 66 of 6 68 ; 9 

\verag - aO.1 79.1 79.5 79 80.3 To. 80.1 14 1.0 


1.6 and the minimum .4. Interpreted in terms of deviation from the av- 
erage, only five (1.9 percent) of the 264 grades reported in the table de 
viate from the average grade for the paper as much as 4 points, 95 per- 
cent of them deviate less than 3 points, 80 percent of them deviate less 
than 2 points, and 50 percent of them deviate less than 1 point. 

As compared with other reported experiments on grading essay pa- 
pers, the lack of variability here is so pronounced that it needs no particu- 
lar comment. For example, a direct comparison between the spread here 
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and that found in the study already mentioned (12) seems valid. In this 
earlier study a set of twenty examination papers in general psychology 
were marked under the same conditions by readers with practically the 
same experience but with the difference that no instructions other than 
to mark on a percentage basis were given. The readers (four of them 
were the same as those used in the present experiment) were three in- 
structors, two readers, and four students in the department, none of them 
with any specific training in reading papers in general psychology. The 
average range for nine readers marking with no instructions was 28.5 
points, the maximum range for any paper was 50 points and the minimum 
range 10 points, and the average probable error was 5.9 points. 

Assuming equally competent readers on these two examinations, one 
scored with rules and the other without, a comparison of the variability 
of the marks before and after conversion to grades makes possible an 
evaluation of the relative role in reducing variability played by the two 
procedures, scoring rules and conversion to grades. When the papers 
were marked with no rules and the raw scores considered, the average 
range was 28.3 points and the average probable error was 5.9; when con- 
verted fo grades (by the method outlined above) the average range be 
came 10.0 and the average probable error 2.2. When the papers were 
marked with rules and the raw scores considered, the average range was 
13.1 and the average probable error was 2.8 points; when converted to 
grades, the average range became 4.4 points and the average probable 
error 1.0 points. The reduction in variability due to conversion to grades 
seems to be slightly more than that resulting from the use of scoring rules, 
but the significant fact is they are obviously independent sources of error 
since their combination reduces the variability much more than either 
alone reduces it. 

OBJECTIVITY 

Used in the sense of reliability of scoring, objectivity is determined by 
keeping the student performance (the papers) constant and varying the 
readers. This we have done, and the lack of variability reported in the 


previous section means the method of scoring and grading used for this 


examination gave rather objective measurement. To get quantitative 
measures of the objectivity two methods were used, correlation between 
a reader and the average of the other readers, and correlation between the 
several readers paired. Since the average of many readings gives a more 
reliable measure than any one reading, the former method would be ex- 
pected to yield higher coefficients and to show less variability than the 
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latter, but the latter would probably more nearly duplicate the usual 
marking situation. 

Table Il presents the coefficients of correlation between the marks 
given by each reader and the average of the other readers, and the average 
coefficients for the marks given by each reader paired with those given 
by every other reader. 


TABLE II 


CORRELATION BETWEEN EACH READER AND THE AVERAGE AND THE AVERAGE CORRELATION 
BETWEEN PAIRED READERS FOR THE TOTAL EXAMINATION 


Reader 


l 2 3 4 5 6 7 s Average 
Freader . average 97 98 97 26 98 96 96 96 97 
aVeTAge Treader . reader 94 95 94 v4 O4 94 “4 93 94 


The coefficients between the marks of a reader and the average are 
consistently high, higher than those usually found. For example, Shriner 
(8) reports an average r of .94 (range from .87 to .97) between each 
reader and the average of 25 readings of a set of algebra papers, and an 
average r of .91 (range .82 to .96) between each and the average of 25 
readings of a set of English papers. For the nine readings of the psy- 
chology papers, scored without rules, mentioned in the previous section 
(12), the average r between each and the average was .91 (range .87 
to .97). The coefficients between the marks of paired readers are lower 
but the average for each reader is agreeably high. The distribution of 
the 28 coefficients (the possible number of combinations) from which 
these averages were determined ranged from .91 to .97 with an average 
of .945. 

These correlations seem to indicate an extremely high degree of ob- 
jectivity for the total examination. What is the relative objectivity of 
the two types of questions, objective and discussion? Beeause the method 
of scoring used means that the number of questions affected the ob- 
jectivity, coefficients such as those determined above would not be com- 
parable for the two types. In order to make them comparable two of the 
objective questions were eliminated at random, thus making the two types 
of equal length, and the correlation between the marks of each reader and 
the average of the eight for the two types of questions was determined. 
These coefficients are presented in Table III. 

The objective questions yield higher coefficients (an average of .96 
compared with .89) but the discussion questions are surprisingly ob- 


jective, especially when we recall the relatively short length of the tests. 


The coefficients varied somewhat from reader to reader, particularly for 
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TABLE III 


CORRELATION BETWEEN EACH READER AND THE AVERAGE FoR Four 
QUESTIONS OF EAcH TYPE 
Reader 
4 § 5 Average 
Objective (4 questions) 
rreader . average 
Discussion (4 questions) 


Treader . average 


96 


go 


the discussion questions, where the range is from .84 to .93, but they are 
based upon a small number of cases and the variations are probably 
chance ones. 
RELIABILITY 
The measurement of reliability, the consistency of student perform- 
ance on different samplings of the materials, will of necessity be attenu- 


ated by any subjectivity in the scoring process, so that the problem here 


is the practical one of determining the reliability of the sampling as ex- 
pressed in terms of the scoring process used. One might determine 
the reliability when the sampling varies but the reader remains constant 
or when both sampling and reader vary. The more practical concern is 
with the reliability of different samplings for the same reader, and since 
high agreement among readers has been found, the study was confined 
to this aspect. 

The Spearman-Brown method was used to determine reliability. In 
order that they might be comparable, the total, the discussion, and the 
objective parts were stepped up to the same length, 10 questions. Such 
a procedure equates the types as to length, but not necessarily as to test 
ing time. Table IV presents for each reader’s marks the stepped-up co- 
efficients for the total, for the discussion, and for the objective questions, 
and in addition stepped-up coefficients for the combined eight readings 
for one-half with the other half. For these last coefficients the objectivity 
is at a maximum, and they may be interpreted as indications of the in- 
herent reliability of samplings of the two types, although they have little 
practical significance. 

TABLE IV 
Sreppep-Up CorerFICIENTS OF RELIABILITY FOR TOTAL EXAMINATION, FOR OBJECTIVE 
QUESTIONS AND FOR DISCUSSION QUESTIONS 


Reader Average of All 
3 4 § } ] \verage Readings 


Total examination 
(stepped-up to 10 questions ) 
Objective questions 
(stepped-up to 10 questions) 
Discussion questions 
stepped-up to 10 questions 
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The average coefficient of the several readers for the total examination 
was .84, for the discussion questions stepped-up to the same number was 
.77, and for the objective questions was .88. The discussion type seems 
to be less reliable than the objective, and this is still true although not so 
much so when we consider the reliability of the average of all readings. 
The reliability is satisfactorily high, and probably compares favorably 
with that of the usual teacher made new-type test. 


CORRELATIONS WITH A NEW-TYPE TEST 

Several studies found in recent literature report a very high correla- 
tion between the @ssay examination and new-type objective tests. Pater- 
son (5) reports an average r of .52 for several correlations between essay 
and objective tests, which when corrected for attenuation (using the av- 
erage reliability which he reports for making the correction) becomes .88 ; 
Corey (1) reports a coefficient corrected for attenuation of .93; Peters 
and Martz (6) report average uncorrected coefficients as follows: essay 
and true-false .74, essay and multiple-choice .78, essay and completion 
.76; Sims (10) reports a corrected coefficient of .99; and Eurich (2) re- 
ports corrected coefficients as follows: essay and completion 1.20, essay 
and multiple-choice .97, essay and true-false .89. However, Eurich also 
reports for another examination (in Educational Statistics) corrected co- 
efficients between types mentioned above of .62, .67 and .66, respectively. 
This finding suggests decided differences among examinations. We have 
pointed out that a large number of elements in the typical essay examina- 
tion are objective, that is, are of the same type as those found in new-type 
tests. To what extent is the high correlation between the two types due 
to the presence of these ‘‘identieal elements’’? This question is a funda- 
mental one, for in spite of all improvement the essay examination can 
probably never give as good measurement as does the new-type test. If 
then the two types measure the same thing, one would recommend the 
new-type for efficient and accurate measurement. On the other hand, 
if it can be demonstrated that the essay examination, or certain types of 
essay questions, measure abilities different from those measured by the 
new-type tests, and abilities that we consider desirable outeomes of in- 
struction, then the essay examination deserves a place in our testing 
program. 

The 33 students who were used in this experiment were given a new- 
type test covering the same subject matter. This test consisted of 40 
true-false statements and 32 completion items and had a reliability co- 
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efficient of .81. Although the two tests were designed to cover the same 
subject matter, no attempt was made to test on the same elements. In 
fact the objective test was prepared the year before. 

Table V presents the coefficients of correlation, both raw and corrected 
for attenuation due to unreliability, between the new-type test and the 
average of the eight reader’s scores on the total essay, the objective por- 
tion, and the discussion portion. The correlation between the objective 


questions and the discussion questions is also reported. 


TABLE V 
CORRELATIONS BETWEEN A NEW-TYPE TEST AND THE TOTAL EXAMINATION, THI 
OBJECTIVE QUESTIONS AND THE DISCUSSION QUESTIONS 


rraw r corrected for attenuation 


New-type with total 83 
New-type with objective 34 
New-type with discussion 49 
Objective with discussion 40 


The indication is that the objective questions and the new-type test 
measure the same thing, while that which is measured by the discussion 
questions is positively, but not closely related to it. The correlation be- 
tween the new-type test and objective questions is very high (r = 1.01), 
but the discussion questions correlate with neither very highly (r = .64 
and .53, respectively). This point obviously needs further experimenta 
tion, for it may be the determining factor in the final disposition of the 
csSay examination. 

SUMMARY 
An essay examination consisting of six objective (simple-reeall and 


short-answer) questions and four discussion questions was given to a 


group of 33 students and the papers were scored by eight readers all using 


the same scoring rules. The rules involved using a seoring key for the 
objective items and rating or sorting the discussion questions. The scores 
assigned toe the set of papers by each reader were converted to percentage 
grades by graphing ihe relation between scores and grades, assuming the 
passing score to correspond to the passing grade and the maximum pos 
sible score to correspond to the maximum possible grade. 

When so seored and graded: 

1. The variation among readers was slight. The average range for 
the grades given a paper was 4.4 points, the average probable error was 
1.0 points. 

2. The objectivity of the examination was high. The average correla- 


tion between a reader’s marks and the average of all reader’s marks was 
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97. The average coefficient between the marks of paired readers was .94. 
The average coefficient between a reader’s marks and the average of all 
reader's marks for four of the objective questions was .96. The average 
coefficient between a reader’s marks and the average of all reader’s marks 
for the four discussion questions was .89. 

3. The reliability was very satisfactory. The average reliability co 
efficient for the total examination was .84, for the objective questions 
stepped-up to the same number was .88, and for the discussion questions 
stepped-up to the same number was .77 

4. The two types of questions (objective and discussion) seemed to 
measure different things. The correlation between them, when corrected 
for attenuation, was .53. The correlation between the objective questions 
and a new-type test over the same subject matter was 1.01 when corrected 
for attenuation, while the correlation between the discussion questions 
and the new-type test was .64 when corrected for attenuation. 
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FACTORS INFLUENCING THE SELECTION OF ASSOCIATES 


May V. SEAGOE 
Stanford University 


EpUCATION in the broadest sense is growth guided toward socially 
desirable ends. This social development is of fundamental importance. 
Education ean control social development only through a knowledge of 
its processes, and such knowledge must begin with the simplest forms 
of social relationship. The present study analyzes one of these forms, 
namely, child friendship. 


I. PROBLEM AND METHOD 

This study has been limited to factors which influence children from 
the third grade through the eighth in their selection of associates. The 
term ‘‘selection’’ includes chance as well as purposive factors. Two ques- 
tions are investigated: (1) To what extent is the child an active agent in 
selection, and how much is he limited by propinquity? (2) Is similarity 
or dissimilarity the more important in the selection of associates? 

A. Preliminary Investigation.—Betfore the study proper was at- 
tempted a preliminary study was made to define the problem and to 
point out fruitful approaches for more minute analysis. A question- 
naire covering possible items of importance was submitted to 72 boys 
and 70 girls representative of grades five to eight, inclusive. 

The first problem was to determine the most valid criterion of in- 
timaey. The child was asked to name his choice for best friend, for 


= york companion, fox social companion, and for confidant. Teachers 


were asked to name outstanding eases of friendship, and the results 
from the two sourees were combined. The relative worth of the four 
criteria was judged on the assumption that the one presenting the highest 
degree of agreement with the rest of the choices made was the best indi- 
cation of intimacy. On the basis of the findings it seems that either the 
best friend or the social companion is a better index than the work eom- 
panion-or the confidant. The social companion is used in the present 
study beeause of the specifie nature of the situation pictured. 

The second phase of the preliminary investigation consisted of an 
analysis of external factors leading toward friendship, «.e., propinquity. 
On the basis of children’s judgments of distance between homes the 
relationship was practically the same as that derived from the study 
proper. Data concerning length of acquaintance showed that in 89.4 
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percent of the cases the friendship had lasted more than one year; that 
ength of aequaintanece increases with age; that length of acquaintance 
nereases somewhat with greater intimacy; and that length of acquaint- 
ince is to a large extent dependent on continued geographic propinquity. 
Length of acquaintance is neglected in the study proper because of the 
diffieulty ef objective analysis and because of its dependence upon 
propinquity. 

Opportunity for association at school as judged by the grade attained 
and the room in which the child was enrolled showed a relationship high 
enough to justify its inelusion in the study. A rough summary of 
chronological ages and of heights indicated that evidences of physical 
maturity were promising factors. A summary of intelligence quotients 
showed a similar relationship. A summary by sex showed a strong 
tendeney for children to choose as friends members of the same sex, a 
tendency which increased somewhat throughout the age range studied. 
Eve-color was not included in the major investigation because its judg- 
ment is subjective and because the preliminary work indicated no definite 
trend either toward similarity or dissimilarity. The personal traits 
given greatest weight were cleanliness, sportsmanship, optimism, kind- 


ness, dependability, agreeableness, helpfulness, similarity to the friend, 


refraining from self-glorification, and external appearance. 

B. The Study Proper—tThe data for the study proper were gathered 
from 115 pairs of friends chosen from 823 children in grades three 
through eight of the Garvey district in Los Angeles county. The pairs 
consist of all children who chose each other in respOnse to the test ques- 
tion: ‘‘Suppose you were going to a party and could invite just one 
person to go with you. Suppose it could be either a boy or a girl, but 
not a member of your family. Whom would you ask to go with you?’’ 
When the same question was repeated one month later, only 29 of the 
original 115 pairs again chose each other. On the assumption that the 
29 represented a closer degree of intimacy, they were treated separately 
as Group I. The remaining 86 constituted Group IT. 

It is significant that in all of the 115 pairs there were no choices 
hetween members of opposite sex. The cases consisted of 55.2 percent 
girls and 44.8 percent boys. It might have been preferable to summarize 
responses for boys and girls separately, but since sex differences are 
supposedly slight for the major part of the age range ineluded and 
since none of the choices were between members of the opposite sex, 


responses have not been differentiated. 
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The study was planned to cover the factors listed in Table I. The 
child was asked for items of common information and for judgments 
concerning his fellows; all data for which more reliable sources were 
available were compiled from such sources. Propinquity was approached 
through home location and through school grade; physical similarity 
was attacked through sex, chronological age, height, weight, and weight- 
height ratio; mental similarity was studied through intelligence quotient 
and mental age; and similarity in personal characteristics was judged 
through pupil opinions. 

TABLE I 
PLAN OF THE STUDY 


Method of Attack 


a 


Factor Studied Item Needed Source Statistical Treatment 
I. Propinquity 
\. Home \ddress Child Get average distance between homes 
Map Principal Express home location numerically 
Compute r. 
B. School Grade Child Correlate grade positions 
Teacher Chik Compute percents in same grade and 
room. 
II. Physical similarity 
A. Sex Statement Child Compute percents. 
B. Chronological age Register Teacher Compute r 
C. Height Health record Nurse Compute r. 
D. Weight Health record Nurse Compute r 
E. Bodily type Transmute height and weight to 


metric units. Compute ratios. 
Correlate ratios. 
III. Mental similarity 
1. I. Q Test record Counselor Compute r. 
B. Mental age Derive from C.A. and 1.Q. 
Compute r. 
IV. Similarity in personal 
characteristics “Who Is It?’ Child Convert into scores Average for 
Test each child in each trait. 
Compute r for each trait and for 
composite 
Four forms were used. The first form was a pupil choice report on 
which the pupil recorded his name, address, grade, teacher, and sex, then 
gave the same items as well as he could for the person he chose. Infor- 
mation for the person chosen was verified from school records. The see- 
ond form was the ‘‘ Who Is It?’’ Test. This device asks the child to name 
a person in his room who is like a given description. The number of 
times a child is named by his elassmates constitutes his score in each 
characteristic. Twelve traits emphasized in the preliminary investiga- 
tion were used as a basis for the test. Either a positive or a negative score 
was possible in each trait. The third form was submitted to the child one 
month after the first and again asked his choice of social companion. 
The fourth form was a summary blank bringing together the data from 
the other forms and supplementing it with height, weight, age, and in- 
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telligenee test data. The intelligence quotients were in most cases 
averages of two group tests. 
With the records complete, statistical work was begun. The homes 


were plotted on a map, air-line distances between pairs were measured, 


and a ‘‘ home index’’ was devised. In order that the relationship in home 
location might be expressed in the same terms as relationships in other 
factors it was necessary to find a means of expressing each location nu- 
merically in order that the figures might be correlated. The purpose was 
not to glorify the correlation technique, but merely to reduce data to 
comparable terms. The supposition was that if pupils live near each 
other they will live approximately the same distance from any reasonably 
distant point. A reference point just outside one corner of the map was 
therefore selected and a right angle was described from the point along 
two sides of the district. The home index was the product of the shortest 
distance from the home in question to each of the reference lines, 7.¢., the 
area of the rectangle thus described. A product rather than a linear 
measure was used to minimize the factor of direction. 

The index is not, of course, infallible. The same product might be 
derived from more than one location. The use of the index was validated 
in two ways. (1) A second reference point at an adjoining corner was 
seleeted to see whether the correlation depended upon the particular point 
chosen. The coefficient from the first point was .874 = .031, and that 
from the second was .744 + .058. Both are statistically significant and 
within two probable errors of each other. (2) Using alphabetic pairing 
a random grouping was ohiained. The coefficient for random pairs was 
056 = .067. On the basis of the present data, therefore, the home index 
appears to be statistically sound. 

Weight-height ratios were derived using the formula 

WwW 
H* 


in metrie units. Mental ages as of the date of the study were obtained by 


\ 100 


multiplying the intelligence quotient by the chronogical age. The results 
of the ‘‘ Who Is It?’’ Test were tabulated; the number of times the child’s 
name was mentioned by his classmates as possessing or lacking each trait 
was founc, and the algebraic sum recorded as his score. The sum of all 
characteristic scores formed the composite. Means, sigmas, and coeffi- 
cients of correlation were computed for both groups for the home index, 
grade, chronological age, height, weight, weight-height ratio, intelligencé 


quotient, mental age, the twelve personal! traits, and for their composite. 
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The average distance between homes for all pupils studied was obtained 
by dividing the district into sixteen blocks, distributing the cases by 
blocks, measuring the distance from each block to all others, weighting 
each distance by the number of cases, and dividing the total number of 
weighted distances by the total number of homes. 


ll, RESULTS 

The means and standard deviations were valuable only in showing 
that the subjects used were representative of the general population of 
the grades included. All measures were near the norm for the age in 
question. , 

A summary of correlations is presented in Table Il. The coefficients 
for Group II are probably more reliable on the whole because the num- 
ber of cases involved was considerably larger. 


TABLE II 
COEFFICIENTS OF CORRELATION 





Factor Coefficient of Correlation 
— ‘ = 
Propinquity: Group I Group II 
Home index 874 + .031 766 + .032 
Grade 959 + .010 949 + .007 
Maturity 
Chronological age .866 + .031 803 + .025 
Height 22 + .126 543 + .055 
Weight 459 + .108 634 + 047 
Weight-height ratio — 149 + .135 010 + .116 
Intelligence 
Mental age 675 + .078 779 + .O31 
Intelligence quotient 513 +> .105 386 > .067 
Personal characteristics : 
Beauty — .097 + .123 056 + .073 
Athletic ability 343 + .110 346 + .064 
Courtesy 167 > .121 299 + .066 
Ability to interest listeners — .095 + .123 116 + .O71 
Cleanliness 349 + .110 468 + .057 
Sportsmanship — 116 + .124 234 + .068 
Amiability — 027 + .124 133 + .071 
Kindness — 243 + .118 112 + .O71 
Dependability — .242 + .118 145 + .071 
Lack of quarrelsomeness .210 + .120 121 + .071 
Helpfulness B74 +> .108 017 = .0738 
Lack of snobbishness 277 + .116 — 112 + .071 
Composite .140 + .123 820 + .065 


The measures of propinquity show the greatest relationship. The 
mean distance between homes was .26 miles for Group I and .33 miles for 
Group II. The average distance between unselected homes was .92 miles, 
or about three times that between the homes of associates. Sixty-two and 
nine-tenths pereent of Group I lived less than .20 miles apart. Greater 
geographie proximity appears to be the only respect in which Group I is 
consistently more closely related than Group II; it seems to be a potent 
factor in the continuation as well as in the formation of friendships. Pro- 
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pinquity as measured by the home index also showed a close relationship. 

Propinquity at school was of considerable importance. About 75 per- 
cent of both groups were in the same grade and an equal percent in the 
same room. The correlation between the grade attained by associates 
was high. 

The correlations between measures of physical maturity were also sig- 
nificant. When age was held constant in the weight-height ratio, however, 
the correlation disappeared. It is physical maturity rather than bodily 
type which produces the correlation. 

The correlation between mental ages was relatively high. When age 
was held constant in the intelligence quotient the coefficient was lower, 
but still significant. There appears to be a reliable relationship in mental 
capacity as well as in mental maturity. 

Finally, the twelve personal characteristics showed some relationship. 
Data for Group I can be interpreted only in the light of agreement with 
Group II due to the small number of cases and to the relatively low co- 
efficients. Correlations more than four times their probable errors in 
Group II were found for athletic ability, courtesy, cleanliness, and to- 
tal score. 

Ill. INTERPRETATION 

The results seem to show two tendencies. (1) Propinquity as a force 
limiting friendship is given emphasis. (2) All the data on similarities 
shows that likeness is of greater importance than difference in social 
attraction. 

The factor of propinquity may function in two ways. First, pro- 
pinquity limits opportunity for acquaintance. Such limitation is con- 
ditioned (a) by a chance element which is shown in measures of pro- 
pinquity at home and at school, and (b) by a social element which is evi- 
denced in measures of intelligence and of personal characteristics. The 
existence of the social element is based on the assumption that there is a 
differentiation of social background among occupational and other types 
of social groups, and that the child’s personal characteristics are to some 
extent moulded by his social background. Similar homes produce similar 
child attitudes, which in turn result in attraction between the children. 
The child, being influenced in his selection by similarity, selects for the 
most part companions whose social heritage is similar to his own. 
Courtesy and cleanliness are two characteristics in which this tendency 


is shown in the present study. 
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Second, propinquity limits the opportunity for continuation of con- 
tact, and it is continued contact which keeps friendship alive. Contact 
leads to habituation. Expressing this deterministic view, less technically, 
we do not deliberately institute a search for persons of a set pattern for 
our friends; we are limited by the breadth and the depth of our contacts. 
The educational implication is obvious; throw the child with the sort of 
persons with whom you wish him to be intimate; they will help form his 
tastes, and with the tastes an attachment to persons having those tastes. 

Within the limits set by propinquity, however, we select associates 
according to the satisfyingness of our contacts, and according to the pleas- 
ure we obtain through our associates. Propinquity marks the boundaries 
within which we may choose; similarity conditions our choices Within 
those boundaries. We enjoy the companicnship of persons of the same 
age and physical maturity, of the same intelligence, and of the same dis- 
position. The desire for response seems to be fundamental in human 
nature; perhaps our selection of similar associates is related to the desire 
for response. Similar persons are most capable of responding to all our 
moods; an inferior would not be sufficiently responsive, and a superior 
would too often offend by surpassing us and thus wounding our self- 
esteem. Similarities were most obvious in the ease of physical maturity 
in the present study, but it is possible that if intelligence and other per- 
sonal characteristics could be measured with the precision used in physi- 
cal measurements the relationship there might be equally high. 

The study is, however, only a suggestive attack upon two factors in 
friendship. The age-range should be increased. The factor of age should 
be equated in all measures. Better measures of relationship between 
homes and better measures of personal characteristics must be devised. 
A different method of determining the most intimate friend should be 
used to check the results presented. Suggestions for further study in this 
field include: (1) An analysis of differences between sexes, between age- 
groups, between mental levels, and between varying degrees of propin- 
quity in the extent to which each of the factors suggested above operates. 
(2) An evaluation of the personal characteristics to determine inter- 
correlation, correlation with intelligence, and correlation with age in 
order to ascertain the degree to which personal characteristics are depend- 
ent upon other factors. (3) Further studies of propinquity showing the 
extent to which propinquity colors relationships in age, grade, ete., the 
extent to which density of population increases the more consciously se- 
lective factors in friendship, the numerical extent of the social contacts of 
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the average child, and the extent to which Sunday-school, work, social 
contact of families, and other similar conditions imfluence the choice of 
companions. (4) A study of the constancy of child friendships and the 
factors involved. (5) A study of leadership using a similar technique to 
determine the extent to which friendship and leadership are related. 
6) An experiment controlling the factor of propinquity by rotation and 
analyzing the consciously selective factors which appear. 


IV. CONCLUSIONS 
In summary, the investigation shows that: 
Measures of propinquity show the highest degree of relationship. 
a. Correlations for home location are in the seventies and eighties. 
b. Mean distance between the homes of associates is .26 miles com- 
pared with .92 miles for unselected pupils. 
ce. Correlations for grade approximate .95. 


d. About 75 percent of the pairs of associates are in the same grade 


and room. 
Measures of physical maturity correlate significantly. 
a. Age, height, and weight give coefficients ranging from .86 to .42. 
b. When age is held constant, the relationship between weights and 
between heights disappears, showing the correlation to be a fune- 
tion of maturity. 
Measures of mental level and of mental capacity correlate significantly. 
a. Mental ages correlate 67 and .78. 
b. When age is held constant in the intelligence quotient the correla 
tion is lower but still significant, t.e., .38 and .51. 
There is a slight but significant relationship between associates in the 
personal characteristies of athletic ability, cleanliness, courtesy, and 
total score in socially desirable traits. 
Evidence is therefore presented in support of two principles, namely : 
1) Propinquity is a strong factor in the selection of associates among 
children. (2) Similarity is more important than dissimilarity in the se- 
lection of associates. 
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STATISTICAL DETERMINATION OF THE SOCTAL 
SCIENCE CURRICULUM 


EpWARD O. SISSON 
Reed Colle ge 


THe advance of the social sciences in the curriculum during the last 


twenty years has been nothing less than phenomenal, particularly in the 


secondary school where this subject has won the paramount place so long 
held by the so-called classics. The subject-matter in this field is plainly 
of prime importance in training for life and citizenship; it is also so rich 
and varied as to make the problem of curriculum-building peculiarly 
formidable. It was inevitable that the new technique of measurement and 
statistieal procedure should be called into service in the selection and or- 
ganization of material; this technique has proved its value in other fields, 
notably spelling and arithmetic, and will doubtless give aid in the social 
sciences. This article is written with the view that such statistical re- 
search is desirable and indeed necessary, but is subject to peculiar haz- 
ards, some of which it is the purpose of this paper to discuss. 

We may begin with one of the more ambitious projects in the field, 
namely, Wasnburne’s study published in 1923 in the Yearbook of the 
National Society for the Study of Education, Part Il. This study pre- 
sents a ranked list of 1500 ‘‘ persons, places, dates, and events’’ (although 
strictly speaking, there are no dates as such in the list). The list is to 
‘form an objective basis for a fact course in history and geography’’ 
The 1500 topies are the boiled-down quintessence of some 80,000 
‘‘mentions’’ gathered from periodicals and books over a period of six 
years; each item in the final list is scored on the basis of its mentions, 
and the items under each score are ranked among themselves by a refine- 
ment of the statistical process. 

The seores run from 103 down to six, items with scores below six hav- 
ing been disearded. The report then declares that ‘‘we thereby obtained 
a strictly objective ranking of all our items . . . It shows, therefore, the 
relative importance of these items from the standpoint of enabling chil- 
dren to read intelligently.’’ A list of items taken from the extremes of 
Washburne’s list is given below to illustrate the problem under discussion. 
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Some Items with Score 6 Some Items with High Scores 
Pan-American (Federation, Con- 

gress, ete.) Greece ; 78 
(‘ontinental Congress ( American ) Switzerland 69 
Interior Department of U.S. Rudyard Kipling 56 
John Marshall Persia 50 
Civil Service : W. J. Bryan 47 
John Dewey Los Angeles 36 


This list could be continued almost ad libitum without diminishing 
the violence of the contrasts. Astonishing juxtapositions also occur: 
inder score 7 appear these two sets of items: 


Prohibition Cornwall 

Herodotus Kaffir 

Valley Forge Howard Pyle 

Pasteur Bessarabia 

Alexander Graham Bell Strand (London) 

Versailles Peace Treaty Grand Central Station (N. Y.) 


Seoring 9, that is fourth from the bottom, are American Expeditionary 
Force, Peace Conferenee, Central Powers (World War), Magna Charta 
(‘abinet (U.S. President’s) ; under the same score there is also a mass of 
trivialities. Seoring 18 we find the American Federation of Labor, and 
the Constitution of the United States; but also Tibet, San Diego, Solomon 
King), Central Park, and Bronx. The Supreme Court of the U. 5. 
climbs to a seore of 29, along with Rochester, N. Y., and Henry C. Lodge. 
The scoring of persons is no less surprising: Rudyard Kipling, 56; 
Christ (ineluding Jesus), 50; and J. Daniels, 24. Henry Van Dyke 
outranks Seott and Goethe. Martin Luther, Daniel Webster, Cicero, 
(Constantine, and Lenin seore 15; but also do D’Annunzio, Thomas 
Hardy, Champ Clark and Huerta. Under 8, come Henry George, Henry 
Clay, John Quincey Adams, Wm. M. Lorimer, William J. Locke, and 
Joseph Pennell. Obseured in the lowest rank are John Brown, John 
Stuart Mill, Pericles, Peter the Great, and Patrick Henry; with them 
are placed Lee Schubert, Roger M. Sullivan, and George M. Cohan." 


‘ Another study based upon counting mentions offers a list of 59 persons: the list 
includes Buchanan, Burr, Bryan, Harrison, MeKinley, Shaw, Taft, Tyler; but fails 
to include Columbus, Charlemagne, Burke, Emerson, Frederick the Great, Pasteur, 
Socrates, Jesus, James Watt, or Walt Whitman. (Earle Rugg. Curriculum Studies 
in the Social Sciences and Citizenship. p- 53.) 

A list of 18 cities takes in Glasgow, Manchester, Stockholm, but omits Rome and 
Geneva. (Op. ert. p. 38.) 
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Two methodological errors, both of vital importance in relation to the 
problem of the curriculum, seem to stand out in the study: first, words 
are counted rather than ideas or concepts. Item 1, with its score of 101, 
is ‘‘America’’ (meaning U. 8.); it is followed lower down by ** United 
States,’’ ‘‘South’’ (U. S.), ‘‘ West’? (U. S.), ** East’’ (U. S.), ‘‘North’’ 

U. S.), and **Middle West’’ (U. S.). Item 2, ‘* England,’’ is followed 
by ‘‘Great Britain,’’ *‘Ireland,’’ **‘Seotch, Scotland,’’ and far down the 
list, ‘‘ British Isles,’’ ‘‘Britain’’ (ancient and modern), and ‘* Wales.’’ 
Curiously enough British Empire is not to be found, although high up 
are **Canada,’’ *‘ India,’’ ‘‘ Egypt,’’ and ‘* Australia.”’ 

The second main error lies in the counting of mentions without weigh- 
ing them. Certainly the list does show one thing, namely, the relative 
number of times the various items were mentioned in the material cov- 
ered by the study; but it would seem to be a great leap from this to the 
conclusion that frequency of mention represents importance in a social 
science curriculum. It would not appear statistically defensible to in- 
clude in a series of sums a series of unequal units such as are merely 
counted in this investigation. The equality of units is the mathematical 
prerequisite for any counting; certainly, absolutely equal units do not 
exist in the world of reality, at least within our control; and our best 
measurements are approximations. Yet, unless the units may properly 
be taken as equal, the mathematical procedure is invalid, and the data 
arrived at are meaningless. It may be urged that the quantification of 
mentions is inherently impossible; if this is true, it would seem then that 
the counting of mentions must be given up as a mode of determining im- 
portance. It seems clear, however, that it is not true, for certain studies 


do undertake to quantify mentions, one method being to draw material 


only from the writings of experts, and the results seem to afford support 
for the procedure.” 

Even with the aid of methods which tend to select only relevant and 
important mentions the process of ranking seems hazardous. The Billings 
study first uses only expert matter, the writings of ‘‘ frontier thinkers’’ in 
the field; it also adopts an elaborate scheme of determining, first a set of 
generalizations, next an organized group of central themes, and finally 
«xtracting from these a ranked list of concepts, 505 in number. Again 
we have rankings which seem quite unjustified. Consider the following 

*Hockett, J. A. A Determination of the Major Social Problems of American 
Life (1927); Billings, Neal. A Determination of Generalizations Basic to the So- 


cial Sciences (1929). Five studies reported in E. Rugg, op. cit., Table XVIII, p. 162, 
exhibit other methods of selecting only relevant and important mentions, 
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exhibit of high and low scores (the top score is 349, the lowest 2, with 101 
items; the median 6) : 


Homogeneity 91 Constitution (political) 3 
Specialization 70 Cost of living 

Personality 44 Economic wellbeing 
Ability 39 Freedom of speech 
Sympathy 32 Markets 

Energy 30 Statesmanship 2 
Impulse 12 Finance 


This list could be extended greatly without materially diminishing the 
discrepancy between the high and low items. It is true that the contrast 
here is not between great and small items, for the items in the high list 
are all matters of profound moment, but they are hardly of a nature to 
afford guidance in the formation of a curriculum; the low-score list, on 
the contrary, is composed entirely of social science topics of the very first 
rank, yet the mean rank of these topics would demote them to meager 
consideration or even hazard their omission. 

It would seem that the trouble here is at least in part verbalism: the 
first column above ineludes words which tend to figure abundantly in an) 
discussion of human affairs, but hardly one of them really denotes a socia! 
science concept; while the second column does present a group of such 
concepts. The top item in the list, with its supereminent score of 349, is 
‘‘thought (or men’s thoughts, motives, desires, ete.) ;"’ the sixth item is 
‘‘life (in general) or life aetivities;’’ item 15 is ‘‘economie conditions in 
general (economic life).’’* Not a few items among the high seores ar 
vague or general in the highest degree: such as ‘‘supply,’’ ‘‘ association 
with others,’’ ‘‘institution, happiness,’’ ‘‘human history,’’ ‘‘know!- 
edge,’’ ‘‘ philosophy,’’ ‘‘men’s spirit (attitude),’’ ‘‘ambition,’’ *‘intelli 


99 é6 
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gence,’’ ‘‘emotion (men’s emotions)’’; all these and many like them are 
in the top quarter of the list with scores of 23 or over. It is hard to es 
cape the view that all these items are indeed vital and significant aspects 
of life, but very far from being either social science concepts or suitab|: 
topics for the curriculum. 

For a third ease of the use of ranking we turn to Table CVIIT i: 
Rugg’s study referred to above. The table is entitled: ‘‘Comparison of 
Twenty Topies Judged Most Important on Criteria of Life Values and 
Actual Rank (proportionate emphasis) in Representative Textbooks.’ 


*Curiously enough this vast theme is outranked by ‘‘ price,’’ ‘‘ geographical en 
vironment,’’ ‘‘loeation of political power,’’ and ‘‘migration,’’ all important topic- 
yet not conceivably of more importance than a topie which seems to comprise the whol: 
science of economics, 
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rhe table sets out the top twenty topies in six lists; the first five lists are 
rom different sources and by different hands; the first is based upon 
latforms of the two major political parties, and the other four are based 
pon periodical literature with some inclusion of books. Each of these 
tive studies is more fully reported earlier in the book. The sixth column 
; headed ‘‘ Textbooks’’ and is apparently intended to be broadly repre- 
entative, but the writer has been unable to trace its definite derivation. 
(he table makes no claim to authoritative determination of relative im- 
portance of topies; however, it serves to exhibit the hazard of ranking. 

Particular items range from high to low; each list contains items not 
found in any other and each omits items prominent in others. ‘* Educa- 
tion’? runs from fourth to twentieth place and is absent in two lists; 

world-order’’ and other terms closely synonymous rank at or near the 
top in three lists and are absent in the other three. ‘‘Bolshevism’’ stands 
fourth and eighteenth in two lists and is absent from the rest; it should 
be added that ‘‘radicalism’’ is listed tenth in a third list, and ‘‘socialism”’ 
is eleventh in the list which places ‘‘bolshevism’’ fourth. ‘‘Immigration’”’ 
ranks third, fifth, tenth and eighteenth, with two absences. ‘‘ Prohi- 
hition’’ gets into two lists only, ranking twelfth and eighteenth. 

Verbal identity is rare between the lists; four terms occur four times 
each: edueation, recreation, immigration, and labor. Three occur three 
times: finance, taxation, and commerce; ten items occur twice. Thus 
we have a total of 92 different terms in the six lists with their 120 items. 
This, of course, throws the problem back to concepts; but here, as else- 
where in ranked lists, this undertaking is too formidable for the framers 
of the lists; it is easy to count words, but also futile. 

The six lists conflict not only in details but also in the largest phases. 
lf we order the topies under certain large general heads, such as politics, 
industry and labor, commerce, finance, social problems, foreign relations, 
we find the greatest discrepancy in rank and stress: politics, commerce, 
finanee, and social problems are absent each from one list; finance is 

bsent from two. The author himself presents a final list of 24 topies. 
ut with no indication of the method of selection. Here, again, strange 
things oeeur; social problems with a total of 13 mentions in the tabulated 
lists does not get into this final list, yet room is found in it for canals and 
PENSIONS. 

Many other examples of ranked lists are available in the literature of 
edueation. While later methods of collecting data tend to correct the 
vross Inequality of mentions referred to above, no means has yet been 
ffectively used to escape the mere verbalism of those lists. 
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A TECHNIQUE FOR MEASURING THE ABILITY TO EVALUATE 
OBJECTIVE TEST ITEMS' 


J. R. GERBERICH 
University of Arkansas 

THIS report presents an experimental development of a test technique 
for measuring the ability to evaluate objective test items. Courses deal- 
ing with the new-type classroom test should be designed not only to equip 
the student with a knowledge of the principles underlying the construe- 
tion of objective test items but also to develop a critical attitude in the 
evaluation of such items. It is probable that more emphasis is usually 
placed upon factual knowledge in measuring the outcomes of such courses 
than upon the more intangible outcomes which are dependent upon but 
which do not necessarily accompany factual knowledge. 

A special mimeographed examination, consisting of fifty true-false and 
eighteen multiple-response items, was given to the writer’s 1931 summer 
session class in ‘‘Construction and Validation of Objective Tests’’ at the 
end of the unit dealing with item construction and evaluation. The elass 
consisted of forty junior, senior, and graduate students, with the last 
group making up approximately half of the total enrollment. No time 
limit was set for the test except that imposed by the fifty-five-minute 
class period. 

The usual types of true-false and multiple-response items were utilized 
differently in this test than in the usual objective examination. The stu- 
dent was asked to evaluate objective items from the standpoint of a 
teacher contemplating their use in a classroom test. Subject matter from 
geography, literature, educational measurement, and several other sources 
was employed in the items to be evaluated. The subject matter chosen 
was of such an elementary nature that each student evaluating the test 
elements was almost certain to possess adequate factual knowledge for 
their interpretation. Furthermore, as the directions for the test pointed 
out, the truth or falsity of the items (from the standpoint of the pupil 
who might encounter them in the usual test situation) mattered little, 
except as a possible supplementary basis for the student’s evaluation of 
a few items. 

The test elements were of twe types: (1) Good and satisfactory items, 
not subjeet to major criticism as to form or style, (2) Ambiguous items, 
introdueing factors which would tend to confuse the pupil unnecessarily 
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in the usual testing situation and which would, therefore, measure his 
cnowledge of the subject matter plus his ability to puzzle out the intent 
of the teacher. The student was told to indicate his reactions by encircling 
the ‘*Good’’ or ‘* Poor’’ following each item, according to whether he felt 
t to be satisfactory or ambiguous. He was instructed to evaluate the 
method of testing, form, and style of the items, and to disregard the¢ 
worthwhileness or importance of the facts or principles upon which they 
were based, 

The second aspect of the student’s response was presented in the di- 
rections by the following paragraph: 

‘‘After you have indicated your reaction to an item, proceed as 
follows: 

(1) If you marked ii ‘*Good,’’ go on immediately to the next item, 
cithout writing anything on the line indicated for comment. (2) If you 
marked it ‘* Poor,’’ write on the line indicated for comment your reason 
for thinking the item should be eliminated or revised. Use just enough 
words to make your meaning clear; do not use complete sentences. For 
example, ‘‘ Double-negative,’’ ‘‘Ineorreet grammar,’’ ‘‘More than one 
correct response, ’’ and the like are satisfactory, but ‘‘ Ambiguous’’ would 
be unsatisfactory because of being indefinite. 


A comparison of four different scoring methods was made, in order to 
determine the one having the highest reliability and validity. In each 
scoring method it was assumed that a student who correctly marked an 
item as ‘* Poor’’ but who gave no logical reason for such a choice had made 

imost a pure guess or had possessed only a vague idea that the item was 
not entirely satisfactory. Therefore, such responses were given no credit 
n any of the scoring methods. 

Four scores were determined for each student. The first two were 
obtained from unweighted and weighted correct responses, while the last 
two were derived in the same manner as the first two except that cor- 


ection was made for chanee. The second method, which allotted one and 


two points respectively to each *‘Good’’ and ‘*Poor’’ item correctly 


uswered and which made no correction for chance, appeared to be the 
most satisfactory. Objectivity of scoring was indicated by a correlation 
coefficient of .985 between scores assigned independently by the write 
ind another seorer. A reliability coefficient of .930 indicated the test to 
highly reliable. 

The validity of the items making up the special examination was de 


termined by an item analysis. The papers were classified into thre 
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groups on the basis of the term grade, A and B students in the first, C stu- 
dents in the second, and D, E, and F students in the third. The percent- 
ages of students correctly answering each item were computed for the 
three groups. A few representative items are given below, together with 
the percentages of correct responses given by students of the high and 
low groups. 


























Percentages 
Item Correct of Correct 
Number True-False Items Response Response 
29 It appears evident that the new-type ex- 
amination has higher reliability than 
the essay examination. Poor High 92 
Low 0 
(Use of ‘‘appears evident’’ conditions 
response ) 
23 Tennyson wrote ‘“‘Idols of the King’’. Poor High 77 
Low 27 
(‘‘Idylls’’, not ‘‘Idols’’—intentionally 
confusing) 
38 Milton wrote ‘‘I] Penseroso’’. Good High 100 
Low 64 
2 Sufficient data is available to show the 
unreliability of the essay examination. Poor High 92 
Low 27 
(** Data is’’—ineorreet grammar) 
49 Robert Burns was known to be a mis- 
ogynist. Poor High 8&5 
Low 45 
( Difficulty of key word—‘‘ misogynist ’’) 
17 In the development of testing tech- 
niques, less attention has been given to 
the measurement problems of the high 
school. Poor High 38 
Low 0 
(Comparison incomplete ) 
32 ‘*The Prisoner of Chillon’’ was written 
by Hawthorne. Good High & 
Low 55 
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Multiple-Response Items 
15 The 1931 Nobel Prize in Literature was 
awarded to (1) William Shakespeare, 
(2) Sinelair Lewis, (3) Oliver Gold- 
smith, (4) H. L. Mencken, (5) Carl 











Sandburg. Poor High 92 
Low 36 
(Some obviously incorrect — not con- 
temporaries) 
13 Memphis is an important city in: (1) 
Oklahoma, (2) Louisiana, (3) North 
Carolina, (4) Kansas, (5) Tennessee. jood High 85 
Low 64 
11 The Orinoco is a: (1) Lake, (2) Ocean, 
(3) River, (4) Mountain, (5) Island. Poor High 69 
Low 36 
( Use of ‘‘a’’ eliminates some responses) 
8 Springfield is a city in: (1) Missouri, 
(2) Oklahoma, (3) Massachusetts, (4) 
Florida, (5) Illinois. Poor High 54 


Low 36 
(Several correct responses ) 





The discriminative power of the examination as a whole is shown by 
the forty-four out of fifty true-false and thirteen out of eighteen multiple- 
response items which showed a greater or less degree of discrimination 
between students of the three ability groups. Forty-four of the sixty- 
cight items were intended to present some form of weakness, while the 
remaining twenty-four were essentially satisfactory. The items showing 
the greatest discriminative power were mainly those presenting some 
form of weakness, so that the major testing burden was borne by the 
‘‘Poor’’ items. However, two-thirds of the ‘‘Good’’ items contributed to 
the discriminative power of the examination. 


SUMMARY 

A special 68-item examination devised to measure the ability to evalu- 
ate two types of objective test items was given to a University of Arkansas 
class which had just completed a course unit in construction and evalua- 
tion of objective test items. The true-false and multiple-response items 
were to be rated as ‘‘Good”’ or ‘‘ Poor’’ on the basis of their form or style 
for use in objective classroom tests and without regard for the worth- 
whileness or significance of the facts involved. The ‘‘Poor’’ items fur- 
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ther required a brief statement of the reasons why they should be revised 
or discarded. The subject matter of the items was so selected that the 
students were almost certain to have a sufficient knowledge of the facts 
involved to serve as a background for interpreting the items. 

The examination was experimentally scored by four methods. The 
optimum method, as seleeted on the basis of its reliability and correlatiun 
with a final examination and term grades, involved a weighting of one 
point for each ‘‘Good’’ and two points for each ‘‘Poor’’ item correctly 
answered. This scoring method had a reliability coefficient of .930. 
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RESEARCH IN AN EDUCATIONAL CRISIS 


One of the most apparent aspects of the present educational crisis is 
the attack upon ‘‘fads’’ and ‘‘frills.’’ While in general these ‘‘fads’’ 
and ‘‘frills’’ are those subjects most recently introduced into the eur- 
riculum—musie, art, physical education, ete-—they may be any subject 
or group of subjects toward which, for various reasons, enmity may de- 
velop in the loeal community. The older subjects have the advantage of 
human inertia and of support by the tendency of each individual, through 
a process of rationalization, to believe that his own training was best, and 
therefore such subjects appear to be most secure. There is a tendency 
in some quarters to argue the case for the different school subjects. It is 
the writer’s opinion that the lay publie is not interested in nor greatly 
impressed by arguments for the different school subjects. If there is 
anything that is more apparent than anything else in the present educa- 
tional crisis, it is the futility of mere argumentation. On the other hand, 
where carefully organized, unbiased facts have been presented they seem 
to have been generously respected. It has been many times asserted that 
we are living in a rapidly changing world; many of the newer subjects 
do have a place in this new world. A thing that is needed above every- 
thing else in the present educational crisis is a new evaluation of old and 
new curricula in light of changed conditions to determine not how much 
might be expended for education in an ideal society but the essentials of 
a good education in the new era. 

A second point at which research can contribute to the dissolution of 
the present educational crisis is in the field of method. The fact that a 
method is ‘‘older’’ is, of course, no proof that it is better or more eco- 
nomieal. This statement is, of course, equally true of ‘‘newer’’ methods. 
Among other tendencies, there appears to be in some communities an un- 
thinking return to ‘‘older’’ and presumably thoroughly tried methods 
of instruction. There is, however, reliable evidence that some of the 
‘‘newer’’ methods constitute real economies, comparable to those of our 
great industrial inventions. This should not be lost sight of in the press 
foreconomy. This situation makes method a worthwhile field for research 
and reasoned economy. 

A third point at which research can contribute to the dissolution of 
the present educational crisis is in the field of ‘‘panaceas.’’ Shortly we 
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shall probably witness such an outpouring of panaceas, each supported 
by plausible and to some people convincing arguments, as has not been 
witnessed for half a century. The schools and the public need to be pro- 
tected from these ‘‘panaceas.’’ There is probably no greater service, 
within certain limits, that research might render to the school and society 
than the evaluation of panaceas. 

In brief, considering the tempo of the times, there has probably never 
been a time in American education when more careful thinking and re- 
search has been needed than at present: in the classroom and in the lab- 
oratory; and on the part of teachers, principals, supervisors, superin- 
tendents, and specialized research workers alike. 

‘ A. 8. Barr 


EDUCATIONAL RESEARCH IN THE CONTRASTING FIELDS 
OF CHARACTER AND TALENT 


Some good researeh work has been done in the field of socio-economic 
conditions in home life as related to the needed adaptation of school con. 
ditions to the differing opportunities of the children. 

A related field for research but one that is more subjective in its con- 
nections, concerns the educational difficulties resulting from the lack of 
character forming activities for children in the modern homes and com- 
munities. These activities were once provided by the required services 
of all members in the chores and the responsible unions for work to do 
the many things now taken care of by modern mechanical appliances. 

In a number of smaller school systems and more rural districts some 
of the school work is now made an integral part of directed work in the 
home or on the farm and in the community. This directed work has the 
form of laboratory experiences and includes personal responsibility for 
the processes as well as for the results. At the present time this relation 
of school work is generally classed as vocational training for an industry 
of mature life. Both the teachers and the pupils, however, find that the 
result of well organized and completed activities is an admirable training 
in character traits and habits. 

Thouch voeationally limited these codrdinations give definite illustra- 
tion of the effect of completed work to illuminate, expand, and enrich the 
meanings of the particular experiences. Research is needed to determine 
how widely such coérdinations between intellectual development and the 
attitudes, appreciated ends, and standards of conduct for self directed 
citizenship ean be worked out for school and community activities no! 
specifieally vocational, except as social aims and standards are a vita! 
part of all organized civie life. 

Some very extensive experimentation has been initiated in a fiel 
assumed, possibly, to be closely related. The work of the Lincoln Schoo! 
of Teachers College, Columbia University, under Otis W. Caldwell, d« 
veloped in the primary and intermediate grades a coérdination between 
the nurture, through appropriate activities and constructive materials 
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of individual talents and a broader nurture deepening an understanding 
if social values for a richer community life. The school provided ma- 
‘erials and illustrative experiences to enable pupils to follow some of the 
steps by which primitive man advanced his understanding of how to get 
irtistie results and gained the skill needed to make the instruments. 
Each pupil developed in some line of artistic expression and used the 
ibility in some home or comr nity situation. In the same school Harold 
Rugg experimented with ma‘erial and method for social science studies. 
One of the outeomes, significant at least to Dr. Rugg, concerned the effect 
of the appreciation of beauty as a contributing value to social changes. 


Experiments of this kind as well as the directly vocational organiza- 
tions of school and trade experiences are not free from an implied and 
perhaps unconscious assumption that human thought and action run nat- 
urally along single track lines. Dr. Truman Kelley, in his book, ‘‘Cross- 
roads in the Mind of Man,’’ following Spearman’s principle of the exist- 
ence of independent mental factors or unit abilities, extends the possi- 
bility of breaking up a general factor of intelligence, and he provides a 
mathematical formula for the handling of correlations of data from five 
independent variables. By this he provides for mapping, as it were, the 
interconnections of various single track activities in the mind and thus 
shows how each, when crossing one or more of the others, may add or sub- 
traet some element of mental force for the final results. 

This tetrad or the more powerful pentad difference formula is true in 
the physical field of foree, when the action of force takes place in the me- 
chanieal use of machines. It is not shown to be true for the action of 
central energies such as gravity or chemism, where the central energy 
itself maintains motion or pressure and affects the direction of inertial 
movement by a constant factor which is independent of the fact that 
torees from impact or other external sources may cross the path and 
cause a change of the velocity and direction of motion. 


This situation of theory is reported here to emphasize the need that 
both research workers and school supervisors shall seek the facts with re- 
gard to mental action as it embodies the energy for that fellowship which 
established great civilizations and fine realizations of justice, of loyal de- 
votion to friends and to civie virtues, and of the harmonies of form, color, 
tone, and dramatic relations even in ancient times. 

To the observer it seems possible that Spearman and Kelley are work- 
ng along lines of investigation which parallel in a way the work of 
(ialileo in determining the law of inertia for physical bodies of matter. 
lle discovered that the inertia of mass moves it in a straight line without 
‘hange in the velocity of motion (if not affected by gravity or by resisting 
orees) and therefore any force acting on mass is measured in terms of 
‘he product of the mass by the acceleration. This law of inertia made it 

ossible for Sir Isaae Newton to conceive of the second law of matter as 
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a center of constant energy acting between masses. This action is defined 
as a force in direct proportion to the masses and in indirect proportion 
to the square of the distances apart. Gravity is the energy which holds 
masses, moving through space under the law of inertia, to a constant de- 
flection from straight lines into orbits determined by the distances and by 
the other mass relations of all matter. 


If this parallel is carried out for the energy relations between minds, 
then the immediate need in the field of education and of social organiza- 
tion is a new Newton to discover the what and how of an energy of mind 
which draws minds together and holds them in their orbits of action and 
thus explains the union of social efforts by which civilization is seeured. 
The distinetion in human powers is to be observed in the difference be- 
tween the action of individual talents and that of an energy of interacting 
personal character which controls through standards and common ideals 
and appreciations. Talents are individual abilities acting along some 
straight road in life. Character, as here used, is an established wisdom 
and purpose to meet life as a working member in fellowship with all for 
the common advancement of social welfare. It directs the individual to- 
ward that fine ideal described by the word ‘‘gentleman.’’ 

As indicated at the beginning, research in the educational field of 
talent training is receiving much attention and a general principle of its 
inertial action is presented. In the field of character training few definite 
results have been determined or definite principles formulated. However, 
the schools and especially the individual teachers have always directed 
their influence toward maintaining ideals of social responsibility and of 
establishing definite requirements for such concepts as the care of bodily 
Health to serve a healthy mind; Loyalty to associates (one or many) te 
whom fidelity is due; Honesty in conduct and thought; Cheerfulness 
with the spirit of good will; Courtesy that gives respect as to an equal and 
aecepts consideration as due from an equal; Codperation with the 
patience and persistence of a trained morale; Courage to face difficulties 
and dangers with firm determination to earry through; Jndustry that 
includes determination to accomplish the results sought as a self imposed 
obligation ; and Self-control in meeting opposition and in opposing physi- 
eal or moral obstacles to justified lines of action. To these somewhat fixed 
directions of energy, teachers have expected their influence to encourage 
in the able ones an experience of Leadership guided by such character 
elements as those above listed and directed to obtaining group action for 
worthy ends carried on with the same energizing ideals. 

It is evident that an important part of education is involved in this 
partially recognized and almost entirely unorganized work of individual! 
teachers. To the observer it seems to be a great field for the best research 
work and one of vital importance. 

Reported by An Observer. 
G. A. B. 
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Lacey, Joy Mucumore. Social Studies 
Concepts of Children in the First Three 
Grades. Contributions to Edueation, 

No. 548 (New York: Bureau of Pub- 

lieations, Teachers College, Columbia 


University, 1932), 89 pp. 


This study was undertaken in view of 
the growing importance of ‘‘social 
studies’’ in school curricula, the difficulty 

f eurriculum revision and test con- 
struction in this field, and the lack of 
research work on social studies in the 
elementary grades. The specific problem 
selected for investigation is ‘‘a study 

some of the social studies concepts 
hich children in the first three grades 
have. A sub-problem is to find some evi- 
lences of growth in concept formation 4s 
shown by the meanings which they asso- 


ite with them.’’ 


The particular concepts to be studied 
in the main investigation were determined 
by a preliminary study in which a list 

150 pietures (representing different 
social studies concepts such as Mother, 
Easter, Horse, Postman, ete.), and 499 


questions about them was made after 


studying the opinions ef educators and 
issroom teachers regarding social stud- 
es curricula, recent representative cur 
ricula in the social studies, the content 
readers, and personal interviews with 
children between the ages of six and 
ne to determine the child’s natural in- 
rests and activities. The questions and 
ctures were criticised by college classes 


social studies for the primary grades 


and revised on the basis of this criti- 
cism. The use of pictures to represent 
the concepts is regarded as a valuable 
and relatively novel feature of this in- 
vestigation, but it is not clear just how 
pictures were made for some of the con- 
cepts such as Easter, Valentine’s day, 
Summer, Spring, ete. 

The reliability of the test was deter- 
mined by giving it to 100 children and 
correlating odd with even items (the 
score on the test being the number of 
The reliability (cor 
rected by the Spearman-Brown formula) 
of the total test was found to be .809. 


For the main study the test was re 


correct answers). 


duced to one hour in length, (125 pie 
tures or concepts, and 315 questions about 
them). This test was given by the writer 
or others, to 450 children, divided equally 
among the first three grades. 

Tables are given of the percentage of 
rrade having ‘*‘ miscon 


4 
~ 


children in each 


ceptions,’’ defined as cases in which ‘‘ one 


or more errors were mingled with the cor 


rect responses,’ These percentages are 
tabulated separately for each of the 125 
concepts, and show, in general, a decrease 
from the first to the second to the third 
grade. Tables are also given of the pet 
centage of children in each grade ‘‘ who 
have the concepts correct.’’ The mean 
ing of this phrase is not clearly defined, 
but judging by the results, and the gen- 
eral context it probably means making 
one or more correct responses, Just why 
a child should be eredited with having a 


** correct concept’’ because he has an 
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swered one question correctly out of three 
or four on that concept is a little puz- 
zling. These percentages are also tabu- 
lated separately for each of the 125 con- 
cepts and show in general an increase 
from the first to the second to the third 
grade. 

The principal conclusion of the study 
is that ‘‘ There seems to be continuous de- 
velopment in children’s concepts from 
grade to grade. The percentage of cor- 
rect responses steadily inereases with 
progress from grade to grade. At the 
same time there is a steady decrease in 
the percentage of misconceptions.’’ Cer- 
tain inferences are also drawn from the 
study, such as, there is ‘‘need of more 
definite teaching and testing of the com- 
mon social studies conecepts,’’ ‘‘need of 
an inventory test and a pre-test before 
the teaching of units of work set forth 
in the curriculum is attempted,’’ ‘‘need 
of some type of standardized test in so- 
cial studies to determine whether or not 
satisfactory results are being secured in 
the teaching of common concepts of so0- 
cial living.’’ 

Certain inferences are drawn from this 
study which are not justified on the basis 
of the evidence presented. For instance, 
it is found in comparing the raw scores 
on the test for the three grades that the 
ratio of the difference of the means to 
the sigma of the difference of the means 
is larger for grade three minus grade 
two, than for grade two minus grade one. 
On the basis of this evidence it is con- 
eluded that ‘‘there seems to be less dif- 
ference between the first and second 
grades than between the second and third 
grades. The inference is that real dif- 
ferences are not apparent until the be- 
ginning of the third grade’’. The infer- 
ence might just as well be that there hap- 
pens to be a large number of questions 
which are too diffieult for the second, but 
not too difficult for the third grade. Be- 
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fore the evidence presented can be taken 
to show more difference between the sec- 
ond and third tlian between the second 
and first grade one must know that the 
test in question measures with approxi. 
mately equal accuracy in different re- 
gions of the seale. Since this is not 
shown, the conclusion is unjustified. Be- 
fore such conelusions can be affirmed or 
denied, studies will have to be made much 
more carefully than this one, taking into 
consideration recent techniques for eval- 
uating the difficulty of test questions and 
determining the equality of units at dif- 
ferent points on mental measurement 
seales. 

The author recognizes in the earlier 
part of the work that the test results may 
be determined not so much by the child’s 
knowledge as by the particular picture 
and questions used in the test. In gen- 
eral it is recognized that for a response 
to be ‘‘correet’’ can mean only ‘‘ correct 
in so far as this study attempts to de- 
termine.’’ Certain of the inferences 
drawn, however, seem to be in direct vio- 
lation of this caution. The author does 
not hesitate to write ‘‘From the low 
percentages of correctness and the va- 
rious percentages of misconceptions an 
inference would seem to be that these eon- 
cepts have not been taught effectively or 
that they have not been considered of 
prime importanee’’. Another inference 
might be that the pictures, the wording 
of the questions or the scoring of the 
test are not adequate in some instances. 
Another conclusion illestrating a similar 
fallacy is that ‘‘coneepts whieh involve 
personal relationships seem more diffieu!t 
to teach than mere factual information 
about objects’’. Why not infer that such 
concepts are more difficult to test? Spe- 
cifie experiments involving pre-test teac!- 
ing, testing the results, teaching again, 
retesting, ete., will have to be made be- 
fore one can determine whether the dif": 
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ulty is in the teaching or in the testing 
of a given concept. 

HAROLD GULLIKSEN 
lniversity of Chicago 


LULL, HerBert G. Secondary Education 
(New York: W. W. Norton and Com- 
pany, Ine., 1932), pp. xvii + 366. 
Here is a book that the reviewer really 

enjoyed reading. In his judgment it is 
a very sane volume. On every page the 
author exhibits the virtue of never leav- 
ing his reader in doubt as to the posi- 
tion taken in controversial matters—and 
there are many of them. There are nine- 
teen chapters in the volume. The first 
five deal with historical matters, and 
thereby afford a background upon which 
the rest of the book is projected. 

It is our observation that Chapter VI 
and Chapter XIX constitute two high 
spots in the author’s treatment of his 
theme. The former deals with ‘‘ curricu- 
lum lag’’ and the latter with ‘‘indoctri- 
nation and freedom in education.’’ 

Among the factors which contributed 
to the eurrieulum lag from 1893 to 1925 
are listed the reports of stated commit- 
tees which perpetuated over-long some 
faulty pedagogical and psychological 
assumptions; pride of community in its 
traditional eurriculum; failure of sec- 
ondary education to parallel life; and 
so On. 

In his treatment of ‘‘indoctrination 
and freedom in education’’ the author 
spares no words’ in denouncing the 
‘‘child-eentrists’’; neither does he sym- 
pathize with ‘‘artificially imposed’ dis- 
ciplines.’’? What he pleads for is a miv- 
dle position in education? ‘‘The educa- 
tional trail lies between the "mechanistic 
view and classical dualism.’’ Although he 
‘onfesses that he is expressing a faith 
rather than a demonstrable hypothesis, he 
feels that without this faith ‘‘ we are lost 
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in the meshes of institutional deter- 
minism.’’ 

The author’s recommendations in re- 
gard to the curriculums of the junior 
high school, the senior high school, and 
the junior college exemplify his point of 


view. 
HARLAN C. Kocu 


University of Nebraska 


Gou.p, ADRIAN G., AND Dyk, JOSEPH A, 
Exercise and Its Physiology. (New 
York: A. S. Barnes and Company, 
1932), 434 pp. 

This volume is prepared with a view 
to serving ‘‘not only as a textbook for 
students of physical education, and as a 
reference book for advanced students and 
teachers of physiology, but also as leisure 
reading for physicians and others who 
may be interested in the effects of exer- 
eise.’’ The various phenomena which 
occur in the body during exercise are dis- 
cussed, and are compared with the oc- 
eurrences during relative inactivity or 
rest. In the discussion we find a descrip- 
tion of the nervous factors involved in 
muscle contraction, and of the reflexes 
which aid in the control of muscle tonus, 
reciprocal innervation of antagonistic 
muscles, the reflex and chemical control 
of respiratory movements and circulatory 
adjustments. There is also a detailed ac- 
count of the chemical changes occurring 
during muscle contraction, fatigue and 
recovery, including a description of the 
energy conversions and the oxidase 
mechanisms. The conveyance of oxygen 
from the lungs to the tissues is traced, 
with a diseussion of factors governing 
percentage saturation of the blood with 
0, during rest and exercise, and those gov- 
erning transfer of oxygen from the capil- 
laries to the tissues. The basic facts in- 
volved are organized into a logical pres- 
entation of the interrelationships existing 
between various processes, giving a pic- 
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ture of adjustments occurring during a 
short period of exertion and the more 
permanent changes brought about with 
longer periods of training. 

The presentation of chemical changes 
is given in considerable detail and a great 
deal of experimental evidence is given to 
substantiate the views set forth. In the 
discussion of the nervous factors in- 
volved, however, no mention is made of 
certain important contributions. For ex- 
ample, the presence of Langley’s ‘‘ recep- 
tor substance’? between nerve and muscle 
is accepted. There is no mention of evi- 
dence to the contrary, such as that pre- 
sented by Lovett Evans, which makes 
very doubtful the authors’ statement that 
‘*the junctional tissue between muscle 
and nerve is fatigued sooner than the 
musele fiber.’’ The experimental work 
on chronaxie determinations has shown 
chronaxie differences between different 
nerve fibers. The chronaxie of a 
**synapse’’ has never been measured, yet 
it is stated in the text that ‘‘in all prob- 
ability, fatigue products may alter the 
chronaxie of the syrapse or some ad- 
jacent structure relative to that of the 
nerve fiber.’’ 

In the field of hormone control, recent 
evidence by Van Dyke, Bailey and Bucy 
(1929) has thrown doubt on the actual 
production of the substance ‘‘ pituitrin’’ 
by the posterior lobe of the hypophysis, 
making highly speculative Krogh’s sug- 
gestion given in the text that ‘‘it is this 
hormone which is responsible for the nor- 
mal capillary tone.’’ In the same way 
the substances liberated into the blood 
stream by the medulla and cortex of the 
adrenal gland have yet to be accurately 
distinguished and described, so that wide- 
spread theorizing as to the presence and 
effeets of adrenalin in normal bodily pro- 
cesses in the intact organism should be 
only tentatively accepted. 

After discussing various nervous and 
chemical processes, the authors describe 
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interrelationships existing between them, 
and the changes in these relationships 
taking place in exercise and training. A 
few of the factors emphasized by the an- 
thors may be briefly set forth. They 
point to the circulatory system as the 
weak link in the chain of organs involved 
in the necessary adjustments of exercise. 
Its efficiency is primarily dependent upon 
the efficiency of the heart. The size of 
the heart is increased through long train- 
ing and strenuous exercise. The heart of 
the athlete or trained individual has a 
slower more powerful beat which accom- 
plishes more work than the more rapid, 
less forcible beat of the untrained indi- 
vidual. ‘‘The functional capacity of the 
heart determines primarily the limits of 
a man’s power of exertion,’’ 

The increase in size of skeletal muscle 
with training has been shown to be due 
to a filling out of already existing fibers 
with  sareoplasm. The  inerease in 
strength which occurs in training is 
thought to be not wholly due to the in- 
crease in size of the muscle, but also to 
a better neuromuscular codrdination, 
more of the formerly little used muscles 
being brought into play. Neuromuscular 
codrdination is also thought to explain 
the greater efficiency of an individual to 
do a certain piece of work in which he 
has been trained. After training there is 
elimination ef unnecessary and useless 
muscle responses according to the au- 
thors, with elimination of the excess 
oxygen requirement needed for those 
muscle responses in the untrained indi 
vidual. The efficiency of muscles to 
transform energy into muscular work is 
not thought to be inereased through 
training. The capacity of the muscles is 
increased during training, however, 
through an increase in glycogen content, 
an increased capacity to tolerate or buf- 
fer lactic acid, an increase in phospho 
creatine, and possibly an increase in the 
oxidative agents. 
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Other topics dealt with in the final 
apters of the book are second wind, 
notional stress, together with other re- 
iits of exercise than those mentioned 
hove, completing the picture of complex 
djustments occurring during exercise 
nd training. DororHy GULLIKSEN 


University of Chieago 


'wirmYeEr, E. B., AND NATHANSON, Y. 8. 
Correction of Defective Speech. (Phil- 
adelphia: P. Blakiston’s Son and 
Company, Ine., 1932), 413 pp. 

The book is labelled by the author as a 
manual of psycho-physiological tech- 
nique for the treatment and correction of 

Dr. Twitmyer is 


; 


the defects of speech.’ 
professor of psychology and head of the 
corrective speech clinie at the University 
of Pennsylvania. Dr. Nathanson is his 
assistant; and this book is avowedly the 
utgrowth of this clinical work. 

The book begins with the most eloquent 
foreword that the reviewer ever read as 
an introduction to a purely professional 
and technical publication. The authors 
rein not only delimit their field and 
view it from a lofty perspective, but also 
color and outline the details of the field 
so that they stand out sharply for the 
reader, 

‘*The whole cosmic scheme of life is 
applicable to its isolated processes. 
Speech output— verbal end-result of 
thought, differential of man and beast, 
ndex of genius or fool, characteristic of 
philosopher or maniac — is one of these 
solated processes . . . 

Our attack cannot be success- 
ully waged against an uncontrolled en 
ironment; therefore our attack upon the 
problem must concentrate itself upon the 
development of the individual. This 
philosophic and pragmatic concept has 
been the basis for our development of 
the psycho-physiological approach to the 
liagnosis and correction of the defects of 
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speech—to our recognition of a minoris 
locus resistentiae, an aspect of the 
residual diathesis.’’ 

The foreword is indeed a fine piece of 
writing and shows that the authors mean 
to build the structure of their book upon 
a broad and deep foundation of scholar- 
ship. The book intends to include not 
merely a compilation of recipes but a 
statement of the rationale of such 
recipes. 

The major part of the book (334 ow 
of 413 pages) is devoted to corrective 
material and technique. The authors 
have here included long lists of words and 
sentences incorporating the sounds upon 
which the child defective in speech is to 
be drilled. The authors did not construct 
these exercises in haphazard fashion, tak- 
ing each sound and choosing words in 
which the sound is used without reference 
to the practical value to the child of the 
words employed. The. authors have 
chosen 5012 words that appear most com- 
monly in our language. ‘‘In computing 
frequencies and determining classifica- 
tion,’’ they write, ‘‘each frequency word 
was analyzed The purpose of this 
is apparent. It permits of an analysis of 
the actual sound frequency properly 
weighted.’’ Apparently the authors in- 
tend not only to give each defective word 
in the child’s vocabulary an amount of 
drill commensurate with its frequency of 
use by him, but also to give each defective 
sound unit as much attention in drill as 
its frequency in our language would war- 
rant. They include the table of sound 
frequencies upon which their exercises 
are built, beginning with (R) at 2,149 
occurrences out of 16,668 for all other 
sounds, and ending with 173 occurrences 
(CH) out of the same total. 

The authors list the sounds that they 
have thus analyzed in the following 
pages: xvii, 11, 12, 16,17, 19. The lists 
are identical. These lists omit many con- 
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sonant sounds, among them: the (NG) as 
in sing; (ZH) as in vision, azure, Asia; 
(Y) as in young, st(y)udent, yet; and 
its voiceless equivalent, as the initial 
sound in humorous, human, huge: The 
omission of these sounds may mean that 


’ the authors regard them so infrequent in 


our language as to need no attention, or 
that they find these sounds seldom de- 
fective. 

Under the head of ‘‘ The Continuants’’ 
the authors include only five vowels: 
(E) as in meet, (AR) as in far, (00) as 
in moon, (0) as in home, and (I) as in 
mite. The last two sounds are diph- 
thongs. The authors have omitted at 
least three diphthongs and five vowels in- 
eluding such infrequent (?) sounds as 
(A) as in cat, and (OI) as in boy, and 
(OW) as in cow. (Because the authors 
have not employed the system of sym- 
bolization usually employed in modern 
words of this kind, i.e., the symbols of 
the International Phonetie Association, 
there is some confusion as to what sounds 
are meant by their letter-symbols. The 
reviewer here employs the authors’ sym- 
bolication in order not to be ineon- 
sistent. ) 

At the beginning of each section of 
exercises the sound to be practiced is 
described. Many of these descriptions 
are so vague as to be of no benefit, and 
in some instances they. are misleading. 
There are many mistakes in the phonetic 
basis for the practical exercises included 
in this book. In the discussion of (T), 
(D) and (N) no mention is made as to 
which are voiced sounds, while in the 
analogous relationship among the sounds 
(P), (B) and (M) is deseribed as pos- 
sessing ‘‘laryngeal vibration’’ and (B) 
is said to be the same as (P) ‘‘with the 
exception that the compression is less and 
there is grosser approximation of the 
lips,’’ with no mention of the sonant 
feature of (B). For (N) ‘‘the breath 
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is permitted to escape evenly between the 
oral and nasal passages’’—a meaningless 
statement. With the back plosives (K) 
and (G) the authors mention that the 
latter is sonant, but omit to make any 
mention at all of (NG), which is related 
to (G) in the same way that (N) is re- 
lated to (D)\, and that (M) is related 
to (B). In diseussing the (TH) sounds 
the authors make no distinctions between 
the voiced and voiceless sounds, ete., etc. 
The authors seem to be naive amateurs 
in the realm of speech sounds. 

Since the major contribution of this 
book is the practical exercises, it leaves 
the reviewer very little opportunity for 
commendation. All we can say is that 
if the teacher knows his phonetics, he 
will find the word lists helpful; but if 
he does not know his phonetics, the exer 
cises will be misleading. 

RoBert WEST 
University of Wisconsin 


Jounson, Burorp J. Child Psychology. 
(Baltimore: Charles C. Thomas, 1932), 
pp. viii +- 439. 

In recent years the output of books 
treating of the child has been out of all 
proportion to the really significant con- 
tributions to knowledge of this period of 
human development. Writers with one 
new idea or point of view have either 
given a distorted picture of the child, or, 
after completely exploiting their own 
contribution, have fallen back upon out- 
moded material or well-worn systems of 
organization for the remainder of their 
exposition, 

It is safe to say that Dr. Johnson’s 
**Child Psychology’’ will not be included 
in the eategory of ‘‘ just another text.’’ 
The material throughout is new. The 
author’s wide experience in original in- 
vestigations of different developmental 
levels has enabled her to make a very 
judicious selection. Old terms rendered 
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meaningless by use and generalizations so 
frequentiy reiterated as to pass for 
axioms are eritieally observed and some 
have new life and precise meaning in- 
jected into them. 

The writer who would treat of develop- 
ment is faced with a _ distressing 
dilemma: shall the organization be 
along eross-sectional lines or proceed 
longitudinally? To obtain a genetic pic- 
ture of individual development the longi- 
tudinal effect must be preserved by 
skillful transition from one cross-section 
to another. Dr. Johnson has employed a 
topical treatment with longitudinal un- 
folding within the topic. An organiza- 
tion such as this does not provide a uni- 
tary, integrated view of human develop- 
ment from the new-born infant to the 
adult. The crganism as a whole is not 
seen in the process of development. For 
this reason it seems apparent that the 
text was designed not for students of in- 
troduetory child psychology but rather 
for advanced students and for intelligent 
parents with superior education. 

Although topical treatment is admir- 
ubly suited to the needs of the specialist 
it seems regrettable that the author did 
not use one consistent system of organ- 
zation. On the one hand we trace the 
genetic unfolding of the child in the basic 
responses whieh give the chapter head- 
ings: Locomotion, Manipulation, and 
Speech. On the other, we review 
the eharacteristics and possibilities of 
Thought, Pereeption and Attention, 
Learning, Growth, Social Behavior and 
Personality, ete., in the child. To the 
reviewer it seems that the latter should 
be made manifest through the evolution 
of the major activities of the child. Sueh 
an unfolding would give us a unified view 
of individual development and a new and 
vital type of organization. It would also 
seem highly essential that the responses 
serving the general process of alimenta- 
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tion be treated in view of their impor- 
tance in the life economy of the indi- 
vidual. 

The major value of this book, apart 
from the fresh experimental work incor- 
porated, is contributed by the view, again 
and again expressed, that the function or 
role of the educator and parent is to 
assist in the unfolding of the potentiali- 
ties of the individual rather than to im- 
press a rigid, conventionalized pattern 
upon the child; to lead the child through 
guidance and the introduction of appro- 
priate problems and problem-situations to 
develop insight into relationships through 
self-initiated activities rather than to 
learn imposed material in rote fashion. 
In the words of the author: 

‘*In the first four years of life the en- 
vironment of the child should elicit dis- 
crimination by use of all the senses. This 
development comes through specific re- 
sponses by the child selected on the basis 
of his experiences . Only by self- 


initiated activities in response to varying 


forms of stimuli is accuracy of percep- 
tion developed. The adult may chiefly 
aid by setting clear patterns of speech 
and conduct, by providing an environ- 
ment that offers diversified but not con- 
fusing stimulus-patterns, and by giving 
the child an opportunity to select his re- 
sponses and to note their effeet. (p. 278) 

Reasoning develops through solution of 
problems. Many children are prevented 
from facing problems through protective 
habits of adults. A ready-made environ- 
ment offers no problem for the child to 
solve. It is often easier and less time- 
consuming on the part of the child’s 
guardian to solve the problem for the 
child. Training in rote memory is put 
over on the child, (p. 338) 

Studies of learning siow that difficult 
tasks require exploratory activities for 
comprehension of the problems and vari- 
ability in responses before habitual ten- 
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dencies are established. If we set up 
standards of leadership, popularity, sue- 
cessful achievement, honesty, politeness, 
independence, and unselfishness as ex- 
peetations for child behavior in the first 
years it is similar to foreed guidance in 
learning. The child may be put through 
the forms and yet have only a set of 
stereotyped responses for specific situa- 
tions without the development of inten- 
tions toward social behavior that are flex- 
ible in adaptation to varying situa- 
tions.’’ (p. 365) 

A careful reading of this book makes 
all too apparent one of the major defects 
of our textbooks in educational psychol- 
ogy, namely, that their orientation is re- 
versed, They give a casual treatment of 
so-ealled ‘‘original’’ behavior in the in- 
fant and then procede to discuss prob- 
lems of learning and of motivation on 
the basis largely of experiments upon 
adult subjeets. They point from the 
adult infant-wards rather than from the 
infant adult-wards. Perhaps this ex- 
plains why our educational system has 
functioned largely to develop rote learn- 
ing and our exhortations to ‘‘think’’ 
have been so barren of results. 

For the edueated parent Dr. Johnson’s 
book reveals the prospect of an experi- 
mental parenthood under which the de- 
veloping child grows in a material and 
social environment adequate to his ex- 
panding needs, a social environment 
which provides the best models of speech 
upon which to pattern his own vocaliza- 
tions, a world so organized and arranged 
as to bring about clear-cut and integrated 
rather than confused responses, 

Unquestionably this book represents a 
major contribution to the fields of educa- 
tional and child psychology. 

Karu C, Pratt 
Mount Pleasant State Teachers College 
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BoGOSLOVSKY, CHRISTINA STAEL Von 
Houstern. The Educational Crisis in 
Sweden. (New York: Columbia Uni- 
versity Press), pp. xiv + 301. 


In the first section of this book the 
author discusses the national, political, 
and social background of Swedish edu- 
eation, reviewing the development of 
Sweden’s homogeneous people, its state 
religion, the nobility, the Crown, and the 
relationship between the growth of de- 
moeracy and educational development. 
Very naturally this diseussion embraces 
both individual and national interests in 
foreign thought. 

The author in the second section of 
her treatment narrows the discussion to a 
review of the history of educational aec- 
tivities within the realm, the organization 
of the school system, various school com- 
missions, and educational bills. In her 
treatment she outlines the work of the 
several grades of schools, the various 
types of educational institutions, private 
and public, teacher training including 
traveling scholarships and educational 
examinations. 

The next section is confined to a study 
of influences of American education on 
the Swedish system. It includes a survey 
of periodical literature and accounts and 
reports of Swedish travel and study in 
America, together with their effects upon 
educational thought and practice in 
Sweden. 

The fourth section of this interesting 
treatise provides a sort of cross section 
of the educational situation in Sweden in 
the light of educational experience in 
America. 

In her final chapter the author includes 
her own concluding remarks and ap- 
pendices on 

1. Advantages of consolidation 

2. Student examination and American 

college entrance examinations 
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This is a rathér unusual study of a for- 
eign school system, reflecting a relatively 
unconscious imitation of educational pro- 
cedure in one country by another. Per- 
haps this type of educational influence is 
more profound than is effected through 
a conscious and intentional introduction 
of foreign procedure. Since educational 
needs, procedures, and objectives of ne- 
cessity vary with the locality or with the 
nation, conscious adaptation too fre- 
quently becomes an imposition of pro- 
cedures admirably suited to one situation 
but unsatisfactory in another. Improve- 
ment in edueational systems through 
comparative studies of educational ac- 
tivities in other lands are profitable only 
to the degree that they give full account 
of the racial and national background 
of thought, traditional attitudes and the 
aspirations of the people concerned. 

This book is well written, interesting, 
stimulating, and deserves thoughtful 
reading by the teaching profession. 

Davip ALLEN ANDERSON 
Northern Normal and Industrial School 


\seLson, H. H. The Art of Educational 
Research: Its Problems and Pro- 
cedures. (Yonkers -on- Hudson, New 
York: World Book Co., 1933), 
pp. xii + 332. 

Within the past eight years at least a 
dozen general discussions of the method- 
ology of research in education have ap- 
peared, exclusive of numerous specialized 
treatments of the questionnaire, inter- 
view, survey, measurements and _ tests, 
statistics, experimentation, historical re- 
search, case study, legal analysis, activity 
analysis, speculative thinking, ete. Chron- 
ologically arranged, the more general 
hooks, intended for use in graduate 
classes or for field workers, inelude: 
Trow, Scientific Method in Education, 
Houghton Mifflin, 1925; Reeder, How to 
Write a Thesis, Public School Publishing 
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Co., 1925 and 1930; Good, How to Do Re- 
search in Education, Warwick and York, 
1928 and 1929; Crawford, The Technique 
of Research in Education, University of 
Sonthern California, 1928; Bixler, Check 
Lists for Educational Research, Colum- 
bia University, 1928; Alexander, Educa- 
tional Research, Columbia University, 
1928, and later revisions; Almack, Re- 
search and Thesis Writing, Houghton 
Mifflin, 1930; Waples and Tyler, Re- 
searcn Methods and Teachers’ Problems, 
Macmillan, 1930; Whitney, Methods in 
Educational Research, Appleton, 1931; 
Rusk, Research in Education, University 
of London, 1932; Kelley, Scientific 
Method, Maemillan, 1932; and the vol- 
ume under review. 

The reviewer questions the use of the 
term ‘‘art’’ in the title of the latest ad- 
dition to this field, although the author 
justifies it by defining science as a body 
of knowledge ‘‘ formulated with reference 
to the discovery of general truths or the 
operation ‘Of general laws,’’ and an art 
as ‘‘a’ systematic application of knowl 
edge and skill in effecting a desired re- 
sult’’ (p. 1). He maintains that there 
may be science in education but no sei- 
ence of education. It is true that in 
building up a science of education work- 
ers encounter difficulties in determining 
truth unmistakably and for all time, due 
to the host of variable factors involved in 
working with human beings and complex 
social conditions. For that matter, even 
workers in mathematics and physics dur- 
ing recent years have not been nearly so 
complacent as formerly concerning what 
they once considered a fixed order of 
things in their respective sciences. In 
fairness to the author, aside from the 
title, the reader is not likely to consider 
educational research a rule-of-thumb ap- 
plication of deviees according to estab- 
lished routine rather than a type of criti- 
cal analysis and fundamental thinking in 
the search for truth, 
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The reviewer does not agree with the 
classification of investigational method- 
ology employed, which is in terms of the 
purpose for which research is conducted 
rather than in terms of the basal fact 
finding procedure involved. This objee- 
tion may not be serious in view of the 
probability that varying points of view 
employed in classifying research are 
helpful to different types of workers, the 
present scheme being functional in char- 
acter. Other writers have classified and 
discussed research in térms of: fields to 
which applied, place where conducted, ap- 
plication, data-gathering devices em- 
ployed, charaeter of the data collected, 
symbols employed, forms of thinking in- 
volved, control of factors, ete. (See ‘‘A 
Symposium on the Classification of Edu- 
eational Research,’’ Jowrnal of Educa- 
tional Research, May and June, 1931.) 
As a matter of fact the author, in using 
a functional classification of research, has 
included procedures which may be con- 
sidered as essential im conducting any 
sound investigation, which possibility he 
recognizes (p. 47). His five so-called 
methods of research are: descriptive, 
causal, evaluative, constructive, and in- 
tegrative. Would not a comprehensive 
and adequate study of visual education, 
for example, include all of the foregoing 
procedures; a description of present 
status; causa! factors leading to develop- 
ment of this field; evaluation of ob- 
jectives, materials, or methods  in- 
volved; application of findings to class- 
room situations and pertinent recom- 
mendations (constructive type); and an 
analysis of related studies (integrative 


type). 
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It is possible that some students may 
become confused by the elaborateness 
and nomenclature of some of the subjects, 
for example, under the descriptive method 
are socio-historic, socio-survey, genetic- 
socio, psycho-individual, and psycho- 
group; and under the causal method are: 
experimental control, inferred control, 
comparative, analytical, direct, and trans- 
ferred. The reviewer’s preference is for 
the older classification (historical, ex- 
perimental, and normative-survey), based 
more nearly on research technique than 
on purpose involved. 

In addition to the series of chapters 
on the different types of research there 
are discussions of the value of research, 
selection of a problem for investigation, 
and writing of the report. Other chap- 
ters are devoted to so-called tools of re- 
search: statistics, comparison, associa- 
tion, and speculation. Again, these seem 
to be steps, mental processes, or proced- 
ures which might well be employed in any 
good piece of research. The various 
chapters are accompanied by ‘‘study 
questions’’ and well selected references. 
In addition, a good general bibliography 
is provided. Aside from the bibliograph- 
ical references, there are few citations to 
the literature of research methodology or 
to available studies as examples of dif- 
ferent types of investigation. On the 
contrary, the book is in the main an at- 
tempt to present the author’s system of 
research methodology. As such, it de- 
serves a place in libraries, in graduate 
classrooms, and in the hands of field re- 
search workers. 

Carter V. Goop 
University of Cincinnati 
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BULLETINS 


{ Basis for the Allocation of Funds, 
Report on Functions of State Institu- 
tions of Higher Learning in Missis- 
sippi (Nashville, Tennessee: Division 
of Surveys and Field Studies, George 
Peabody College for Teachers, 1933), 
73 pp. 

This bulletin presents a survey of 
higher edueation in Mississippi, the pres- 
ent functions of its institutions of higher 
edueation, and certain considerations that 
should be taken into account in deter- 
mining their functions in the immediate 
future. 


BRAMMELL, P. Roy. Health Work and 
Physical Education, National Survey 
of Secondary Education, Bulletin No. 
17, Monograph No. 28 (Washington: 
Superintendent of Documents, United 
States Government Printing Office, 
1933), vi + 98 pp. 

Bulletin of the National Survey of 

Secondary Education discussing health 

and physical education. 


BRAMMELL, P. Roy. Intramural and 
Interscholastic Athletics, National Sur- 
vey of Secondary Education, Bulletin 
No. 17, Monograph No. 27 (Washing- 
ton: Superintendent of Documents, 
United States Government Printing 
Office, 1933), vi + 143 pp. 

Bulletin of the National Survey of 

Secondary Eduéation discussing intra- 

mural and interscholastic athleties. 
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Cooper, WILLIAM JouN. Economy in 
Education, School Economy Series Bul- 
letin (Stanford University Press, 
1933), 82 pp. 

The author presents data upon the 
need for public school economy, the essen- 
tial edueation at the different school 
levels and suggested economies in pub- 
lie education. 


Coxe, WARREN W., AND CORNELL, 
Erne, L. Pre-service and In-service 
Training of Elementary School Teach- 
ers: Suggestions Derived from an 
Analysis of Teaching Difficulties of 
Recent Normal School Graduates and 
from Faculty Criticisms, Educational 
Monograph of the New York State 
Teachers Association, No. 2 (Albany, 
New York: New York State Teachers 
Association, 1933), xvi + 93 pp. 

This bulletin presents an analysis of 
the teaching difficulties of over 1200 re- 
cent normal school graduates teaching in 
the elementary schools of New York 
state. 


Eppy, Heten M. Instruction in Foreign 
Languages, National Survey of See- 
ondary Education, Bulletin No. 17, 
Monograph No. 24 (Washington: 
Superintendent of Documents, United 
States Government Printing Office, 
1933), vi + 61 pp. 

Bulletin of the National Survey of 

Secondary Education discussing instrue- 

tion in foreign languages. 
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EeLLs, WALTER CrosBy. Teachers’ Sal- 
aries and the Cost of Living, School 
Economy Series Bulletin (Stanford 
University Press, 1933), 94 pp. 

The author presents data on the cost 
of living, and an analysis of the Bureau 
of Labor Statistics’ index number show- 
ing its injustice to teachers. 


ENGELHARDT, FRED AND OTHERS. Dis- 
trict Organization and Secondary Edu- 
cation, National Survey of Secondary 
Edueation, Bulletin No. 17, Monograph 
No. 8 (Washington: Superintendent 
of Documents, United States Gov- 
ernment Printing Office, 1933), 
viii + 208 pp. 

A bulletin of secondary education and 
district organization. 


FRANZEN, RAYMOND. An Evaluation of 
School Health Procedures, School 
Health Research Monographs, No. 5 
New York City: American Child 
Health Association, 450 Seventh Av- 
enue, 1933), xii + 127 pp. 

This is the fifth of a series of school 
health studies published by the American 
Child Health Association. This study 
presents factual materials on the ele- 
ments of a good school health program. 


FREEMAN, FRANK N., AND OTHERS. 
‘*Pupil Personnel, Guidance, and 
Counseling,’’ Review of Educational 
Research, IIL (June, 1933), pp. 
185-245, 

Contains a summary of research re- 
lating to the following topics: school at- 
tendance, school progress, school marks, 
recording and reporting, characteristics 
of pupil population, guidance and coun- 
seling, extra-curricular activities, ad- 
justments and classifications in colleges 
and universities and special schools and 
classes. Bibliography. 
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HAAGE, CATHERINE M. Tests of Fune- 
tional Latin for Secondary School Use 
Based Upon the Recommendations of 
the Classical Investigation, Doctor’s 
thesis (Philadelphia, Pennsylvania: 
University of Pennsylvania, 1932), 
192 pp. 

This bulletin presents data on the con 
struction and validation of a series of 
achievement tests in functional secondary 
school latin. 


HAGMAN, EvizApeTu PLecer. The Com- 
panionships of Preschool Children, 
University of Iowa Studies, Studies in 
Child Welfare, VIT, No. 4 (Towa City, 
Iowa: University of Iowa, 1933), 
69 pp. 

From a study of preschool children the 
author finds that when the measures of 
individual children in each of nine char- 
acteristics were correlated with those of 
their most frequent companions, higher 
correlations were obtained than for all 
pairs. The younger group showed some 
tendency to choose others similar to 
themselves in mental age, intelligence 
quotient, and social reaction, and dis- 
similar to themselves in extroversion. 
Chronological age, height, and weight 
were unrelated. In the older group pairs 
of most frequent companions tend to be 
dissimilar in height and weight, and sim- 
ilar in social reaction to the group. 
Chronological age, mental age, intelli- 
gence quotient, extroversion, and a social 
stimulus index show little or no relation- 
ship to the choice of companions. 


Harcu, FrrepA WARDWELL. ‘‘Status of 
the Social Sciences in Secondary 
Schools of Maine,’’ The Maine Bulle- 
tin, XXXV, University of Maine 
Studies, Second Series, No. 27 (Orono, 
Maine: University of Maine Library, 
1933), 114 pp. 
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The author presents data on the status 
of instruction in the social studies in the 
secondary schools of Maine: constants, 
electives, number of courses offered, size 
of elass, teaching load, the training of 
the teachers, ete. 


KLINE, Linus WARD, AND CAREY, GERT- 
rupe L. A Measuring Scale for Free- 
Hand Drawing, Part II, Design and 
Composition, The Johns Hopkins Uni- 
versity Studies in Education, No. 5 
( Baltimore: The Johns Hopkins 
Press, 1933), 58 pp. 

The authors present a scale for meas- 
uring free-hand drawing with data rela- 
tive to its standardization. 


KRAMER, GRACE A. The Effect of Cer- 
tain Factors in the Verbal Arithmetic 
Problem Upon Children’s Success in 
the Solution, The Johns Hopkins Uni- 
versity Studies in Education, No, 20 
(Baltimore: The Johns Hopkins 
Press, 1933), 106 pp. 

This study undertakes to investigate 
the effects of four faetors: interest, sen- 
tence form, style-language details, and 
vocabulary upon the success of sixth- 
grade children in solving verbal arithme- 
tic problems. While the relationships 
were uniformly low the highest was found 
between ability to solve verbal problems 
and familiarity of vocabulary. The out- 
come of this study would suggest further 
careful investigation before schools place 
too great reliance upon interest content 
or attractive style to aid to any great 
extent in developing reasoning power in 
arithmetic, 


LIVESAY, THAYNE M, A Study of 
Public Education in Hawaii: with 
Special Reference to the Pupil Popu- 
lation, University of Hawaii Research 


Publications, No. 7 (Honolulu, Ha- 
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wail: University of Hawaii, 1932), 

vii + 120 pp. 

This bulletin contains a study of publie 
education in Hawaii: the organization of 
publie education, the population of Ha- 


‘wali, the general distribution of public 


school pupils, the race-grade composition 
of the public school population, and the 


‘progress of the public school population. 


Bibliography. 


Prescort, DANIEL A. The Training of 
Teachers, Rutgers University Bulletin, 
Series IX, Studies in Education, No. 5 
(New Brunswick, New Jersey: School 
of Edueation, Rutgers University, 
1933), 32 pp. 


The author presents a criticism of the 


‘training of teachers in the United States, 
‘and a plan for the training of teachers 
‘based upon firsthand contacts with the 
‘schools in a number of European 
countries, 


)Roperts, KATHERINE Exuiorr. Learning 


in Preschool and Orphanage Children, 
University of Iowa Studies, Studies in 
Child Welfare, VII, No. 3 (Iowa City, 
Iowa: University of Iowa, 1933), 
94 pp. 


The general purpose of this investiga- 


ition was to study the process by which 
‘young children learn the solution to an 
‘initial situation and apply the solution in 
a subsequent series of similar situations, 
iall of which may be solved according to 


the same plan. It is shown that both 
mental and chronological age are import- 
ant factors in the original solution, but 
not in the transfer to similar problems. 


Scor, HzALMAR FLetcuer. Bladder Con- 
trol in Infancy and Early Childhood, 
University of Iowa Studies, Studies in 
Child Welfare, V, No. 4 (Iowa City, 
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Iowa: University of Iowa, 1933), 

83 pp. 

The author presents data on factors 
conditioning bladder control, the child’s 
responsibility, the expected age of con- 
trol, sex differences in control, and the 
features of a practical program of con- 
ditioning. 


SKEELS, HAROLD MANVILLE. A Study of 
Some Factors in Form Board Accom- 
plishments of Preschool Children, Uni- 
versity of Iowa Studies, Studies in 
Child Welfare, VII, No. 2 (Iowa City, 
Towa: University of Iowa, 1933), 
148 pp. 

This monograph gives a description of 

a series of form boards for use with pre- 

school children, their validation, and 

some results obtained with respect to the 
transfer of training and the effect of con- 
ditioning responses. 


Smirn, Henry LESTER, AND NOFFSINGER, 
Forest Rusy. Bibliography of School 
Buildings, Grounds, and Equipment, 
Part IT and Part IIT, Bulletins of the 
Schodl of Education, Indiana Univer- 
sity, IX, Nos. 2 and 3 (Bloomington, 
Indiana: School of Education, Bureau 
of Coéperative Research, Indiana Uni- 
versity, 1933), 183 and 130 pp. 

These bulletins are the second and 
third volumes of a series of three bulle- 
tins giving a bibliography of school 
buildings, grounds, and equipment. Part 
I contained references prior to Octcber, 
1927; Parts II and III references since 
October, 1927. 


Soper, Wayne W. Development of State 
Support of Education in New York 
State, University of the State of New 
York Bulletin, No. 1019 (Albany, New 
York: The University of the State of 
New York Press, 1933), 66 pp. 


[ Vol. 27, No. 1 


This bulletin is the first of a series of 
studies dealing with educational finance 
to be published by ‘the Educational Re- 
search Division of the New York State 
Department of Public Instruction. The 
first bulletin is primarily historical in 
character. 


STANTON, Hazen M., AND KOERTH, 
WILHELMINE. Musical Capacity Meas- 
ures of Children Repeated After Musi- 
cal Training, University of Iowa Stud- 
ies, Series on Aims and Progress of 
Research, No. 42 (Towa City, Towa: 
University of Iowa, 1933), 48 pp. 


The authors present the results of a 
ten-year program of testing and retest- 
ing by the Seashore Measures of Musical 
Talent from which they conclude that 
the Seashore Tests have high scientific 
value as measures of musical talent. 


Theses in Education, Bulletin of the Bu- 
reau of School Service, V, No. 4 (Lex- 
ington, Kentucky: College of Educa- 
tion, University of Kentucky, 1933), 
56 pp. 

An annotated bibliography and ab- 
stract of theses in education, prepared at 
the University of Kentucky, from the 
initiation of graduate work to Jannary 
1, 1933. 


Watson, Giapys Hippie. Suecess and 
Failure in the Teaching Profession, 
Doctor’s Dissertation (New York: 
Department of Psychology, Teachers 
College, Columbia University, 1932), 
99 pp. 

The author presents the results of a 
number of personality and vocational 
tests for a group of 58 students in 
Teachers College, Columbia University. 
The author brings the items from the 
several tests having predictive value to- 
gether into a single representative scale. 
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ZeIGeEL, WILLIAM H. Research in Sec- 
ondary Schools, National Survey of: 
Secondary Education, Bulletin No. 17, 
Monograph No. 15 (Washington: 
Superintendent of Documents, United 
States Government Printing Office, 
1933), vi + 72 pp. 


This bulletin of the National Survey. 
of Secondary Edueation discusses re-- 


search in secondary schools. 


EDUCATIONAL ADMINISTRATION AND 
SUPERVISION 

Ack.ey, C. E. ‘Constitutional Control 

of the Currienlum,’’ Educational Law 


and Administration, Il (July, 1933), ; 


pp- 64-66. 


The author presents the results of an | 


investigation of constitutional restric- 
tions on legislation regarding the cur- 


riculum, 


CHAMBERS, M. M. ‘‘Publie Aid for Col- 
leges Under Private Control,’’ Edu- 
cational Law and Administration, II 
(July, 1933), pp. 53-63. 

The author presents a digest of legis- 
lation relating to public aid for privately 
controlled colleges and universities. 


Hyper, ANNA, AND HybDE, RIcHARD. ‘‘ Vo- 


cational Misplacements’ Among Ele- 
mentary-School Teachers,’’ Elementary 
School Journal, XXXTIT (June, 1933), 


pp. 746-752. 


From a study of the placement of 3955 * 


elementary teachers the authors show 
that regardless of the size of the city 
there is a tendency among school officials 
in the placement of teachers to ignore the 
teacher’s special field of training. 


THompson, Crem O. ‘‘ The Life-Certifi- 
eate,’’? Elementary School Journal, 
XXXIII (June, 1933), pp. 762-768. 
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The author presents certain data rela- 
tive to the life-certification of teachers 
and raises a question concerning the 
worthwhileness of the policy. 


EXPERIMENTAL STUDIES OF LEARNING 
AND TEACHING 
Bruce, R. W. ‘‘Conditions of Transfer 
of Training,’’ Journal of Experi- 

mental Psychology, XVI (June, 1933), 

pp. 343-361. 

This study is an investigation of some 
of the conditions of transfer of training. 
The results are formulated in a set of 
laws. The article contains numerous 
references to previous investigations. 


Cox, JoHn W. ‘‘Some Experiments on 
Formal Training in the Acquisition of 
Skill,’’ British Journal of Psychology, 
XXIV (July, 1933), pp. 67-87. 

An experimental study of the transfer 
of training in the aeqguisition of skill 
where two methods of instruction, the 
‘* praetice’’ method and the ‘‘training’’ 
method, are used in which the author 
finds that mere repetition confers little 
advantage upon the performance of other 
operations, but that where repetition is 
replaced by suitable instruction the skill 
developed at no additional cost of time 
tends to transfer to other operations over 
a wide field of manual activities. 


jaRRISON, K. C. ‘‘A Study of Some 
Factors Related to Leadership in High 
School,’’ Peabody Journal of Educa- 
tion, XI (July, 1933),,pp. 11-17. 


After reviewing previous investiga- 


‘ tions the author presents the results of a 
) statistical study of the relationship be- 


tween school average, height, weight, 
father’s occupational rating, number in 
family, position in family, and leader- 
ship. The correlations were uniformly 
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low, the highest (.36) being with the 


school ave rage. 


GUILER, WALTER ScRIBNER. ‘‘ Improve- 
ment and Permanency of Learning 
Resulting from Remedial Instruction,’’ 
School Review, XLI (June, 1933), 
pp. 450-458. 

An experimental study in which the 
author finds that the progress in the re 
medial group was more marked than the 


non-remedial group. 


Jenkins, J. G. ‘‘Instruction as a Fae- 
tor in ‘Incidental’ Learning,’’ Amert- 
can Journal of Psychology, XLV 
(July, 1933), pp. 471-477. 

After reviewing previous investigations 
the author reports the results of an ex- 
perimental study from which he con- 
cluded that ‘‘intentional’’ learning is 


superior to ‘‘ineidental’’ learning. 


Lirrerer, Oscar. ‘*‘An Experimental 
Study of Visual Apprehension in 
Reading, Journal of Applied Psychol 
ogy, XVII (June, 1933), pp. 266-276. 
Through the application of a number 

of tests the author attempts to discover 

the true relationship between visual ap- 


prehension and achievement in reading. 


OLANDER, Herspert T. ‘‘The Need 
for Diagnostic Testing,’’ Elementary 
School Journal, XXXITITI (June, 1933), 
pp. 736-745. 

The author presents data to show that 
while the forty teachers involved in this 
study were able to diagnose the exact 
eauses of a pupil’s errors in multiplica- 
tion with a high degree of accuracy, their 
suecess in diagnosing errors in addition, 
subtraction, and division was _ limited. 
The average of all the teachers was ap 
proximately 30 percent or less than one 
error out of three correctly diagnosed. 








[ Vol. 27, No.1 


Pickrorp, R. W. ‘‘The Tendency To- 
wards Synthesis in Reading,’’ British 
Journal of Psychology, XXIV (July, 
1933), pp. 50-66. 

An experimental study of reading in 
which the author finds a tendency to- 
wards synthesis in the reading of simple 
and compound passages, each passage 
being treated as a unit only when the 
subject completely fails to unify its 
parts. The tendency to unification is 
fundamental, giving to the materials 
real meaning, 


Symonps, PerervAL M. ‘‘The Psychol- 
ogy of Problem-Solving, Harvard 
Teachers Record, TIL (June, 1933), 
pp. 137-143. 


The author makes a plea for more in- 


formation about the mental processes in 
volved in problem-solving and the im- 
portance of problem-solving. 


CURRICULUM CONSTRUCTION 
CHARTERS, W. W., AND HINDMAN, 

Darwin A. The Duties of Ohio Public- 

Health Commissioners, Ohio State Uni 

versity Studies, Bureau of Educational 

Research Monographs, No. 17 (Colum- 

bus, Ohio: Ohio State University, 

1933), xi + 70 pp. 

This bulletin presents an analysis of 
the duties of Ohio Pubjlic-Health Com- 
missioners for the purpose of curriculum 
construction. The bulletin contains a 
statement of the preecedure, the activities 
of Publie-Health Commissioners in Ohio, 
and suggestions on constructing courses 
of training. 


CLEM, OrLIE M., AND DopGr, Sewarp B. 
‘*The Relation of High-School Lead- 
ership and Scholarship to Post-School 
Success,’’ Peabody Journal of Educa- 
tion, X (May, 1933), pp. 321-329. 
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\ study of the relationship of high 

school leadership to post-sebool success in 

the that 


graduates leaders in 


which author concludes those 


who were high 


school have made a better showing in 
post-school activities than have scholars 


or members of the random g 


ta 


roup. 


KEFAUVER, GRAYSON N., AND MACKENZIE, 
Gorpon N. ‘*The Value of Secondary 

School Subjects in the Preparation for 

Law,’’ California Quarterly of Second 

ary Education, VIII (June, 1933), 

pp. 383 394, 

The authors present an analysis of the 


secondary school subjects required in the 


preparation for law, and the importance 


of these subjects as judged by deans of 


law schools. 


W., 
**Edueation and Re 
Institute : 
I. Reconciling Technical, Liberal, and 
Il. Selecting In 
III. Activity 
Course Con- 


RANDALL, JOHN A., CHARTERS, W. 


AND ELLINGSON. 
search at a Mechanics 
Research Objectives ; 
stitutional Objectives; 
(nalysis as a for 
tent,’’ Personnel Journal, XTII (June, 
1933), pp. 1-15. 


Basis 


the 


years to 


The three articles explain 
taken the 


ascertain 


steps 


during last several 
the 


onstituency and to reconstruct curricu- 


needs of their educational 


lum, content, techniques, and administra- 
tive practices in harmony with re-defined 
aims and with specific objectives whose 
has been 


feasibility experimentally 


ascertained. 


Reavis, WiriwtAmM C. ‘* Interscholastic 
Non-athletie Activities in Selected See 
ondary Schools,’’ School Review, XLI 
(June, 1933), pp. 417-428. 

From an analysis of a questionnaire 


o« 


from which 224 replies were received, 
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the author finds that there are many op 


portunities for pupil practice and par- 


ticipation in a great variety of inter 


scholastic non-athletic activities in sec 


ondary schools. 


STARBIRD, MYRTLE, 
of-School Uses of English,’’ 
lish XXII 


166- 


AND OTHERS. ‘* Out 
The Ena 
Journal, (June, 1933), pp. 
471. 

The author presents an analysis of the 
out-of-school uses of English by 345 high 
school pupils. Tables and index numbers. 
WituiaMms, L, A. 

in Currieuium-making,’’ 


XLI 


The author presents an analysis of the 


** Analysis Techniques 
School Be 
view, (June, 1935), pp. 437-442. 
job analysis, activity analysis, functional 
analysis, and content analysis techniques 


in curriculum construction. 


MEASUREMENTS, 
STATISTICS, AND METHODOLOGY OF 
SCIENTIFIC 

HARRY A., AND 
‘‘A New 

for the Study of Oral-Language Ac 
tivities,’’ Elementary School 


XXXIIT (June, 1933), pp. 753-761. 


The authors present data on the per 


RESEARCH 
GREENE, Betts, 
EMMETT A. Technique 


Journal, 


centage of errors made hy ordinary re- 
cording devices and a description of a 
The 


apparatus may be used for a variety of 


new language recording apparatus. 
recording purposes. 


KARL J., 
‘* Selected 

and Theory of 
School Review, 


162-466, 


HOLZINGER, AND SWINEFORD, 
FRANCES. 


Statistics 


References on 
Test 
XLI 


Con 
struction,’’ (June 
1933), pp. 
An 
tistics and the theory or test construction 


of thirty selected titles. 


annotated bibliography on _ sta 








a —— ——_— 


mae 


a i A 








VQRARCRRRARRKRRTRRIARA KARAM 
RESEARCH NEWS and COMMUNICATIONS 


x 
a Rt 
Address all research news and communications to Carter V. & 
Good, Teachers College, University of Cincinnati, Cincinnati, & 
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SELECTED BIBLIOGRAPHY ON 
TECHNIQUES OF EDUCATIONAL RESEARCH AND 
RELATED PROBLEMS, 1932-33" 


CARTER V. Goop 
University of Cincinnati 


Tuts, the fourth annual bibliography CHARACTERIZATION AND EVALUATION OF 
on research techniques to be published in RESEARCH AND EDUCATIONAL PROCEDURE 
the Journal of Educational Research, is  Ajmack, J. C. ‘Scientific Method in 


intended to be of service to three groups Teaching,’’ Educational Method, XII 
of individuals: field workers interested (March, 1933), 321-24. 
in research, graduate students, and staff parnes, H. E. ‘‘The Development of So- 
members of higher institutions. ciology,’’ Scientific Monthly, XXXV 
The bibliography covers the period (December, 1932), 543-53. 
from approximately June 1, 1932, to Bernard, L. L., and J. 8. ‘‘A Century 
July 1, 1933. Limitations of space have of Progress in the Social Seiences,’’ 
made it necessary to select those refer- Social Forces, XI (May, 1933), 
ences of greatest practical value to fied 488-505. 
workers, graduate students, and staff Briggs, T. H. ‘‘A Vision of Seeondary 
members of teacher-training institutions. Education,’’ Teachers College Record, 
Therefore, highly technical discussions of XXXIV (October, 1932), 1-17. 
a statistical and mathematical character (Caldwell, O. W. ‘‘Seience—Truth or 
have been omitted. Propaganda,’’ School and Society, 
The centers of interest for the past XXXVII (February 11, 1933), 169-74. 
year, as represented in the bibliography, Qpharters, W. W. ‘‘The Value of a Re- 
are: evaluations and predictions of prog- search Organization,’’ Educational Re- 
ress in given fields; an increasing num- search Bulletin, XI (October 26, 1932), 
ber of bibliographies, summaries of edu- 351-52. 
cational literature, and abstracts of grad- Cox, P. W. L. ‘‘The Research Racket,’’ 
uate theses; needed studies; methodol- Junior-Senior High School Clearing 
ogy of research; and training and guid- House, VII (January, 1933), 260-65. 
ance of graduate students and research A criticism of questionable practices in 
workers. educational investigation. 


Davis, R. A. ‘‘Research and _ the 


* Suppl tary to bibli hi - 
ee a ee oe ee Schools,’’ Journal of Educational. Re- 


viously published in the Journal of Edu- 


cational Research, October, 1930; Sep- search, XXVI (April, 1933), 561-68. 
tember, 1931; October, 1932; and Carter Douglass, H. R. ‘‘Does the Future of 
V. Good, How To Do Research in Educa- f ‘ 

tion. Baltimore: Warwick and York, Sequwtary Education Depend — 
1929. Statistical Research in Foundational 


72 
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Thinking?’’ Education, LITI (Janu- 
ary, 1933), 284-89. 

Eginton, D. P. ‘‘ Research, the Fourth 
‘R’,’’ Journal of Education, CXV 
(Oetober 17, 1932), 574-75. 

Gee, W. P. Research Barriers in the 
South. New York: Century Co., 1932. 
Pp. 192. 

Gray, J. 8S. ‘*Seientific Postulates for 
Edueational Research,’’ Educational 
Administration and Supervision, XIX 
(January, 1933), 18-24. 

Harap, Henry, and Bayne, Alice J. ‘‘A 
Critical Survey of Public School 
Courses of Study Published 1929 to 
1931,’’ Jowrnal of Educational Re- 
search, XXVI (October, 1932), 105-09. 

Howell, C. E. **The Functions of a Re- 
search Department,’’ American School 
Board Journal, LXXXV_ (November, 
1932), 50, 64. 

Hutchins, Robert M. ‘‘The American 
Edueational System,’’ School Review, 
XLI (February, 1933), 95-100. 

Judd, C. H. ‘*The Scientifie Develop- 
ment of the Curriculum,’’ Elementary 
School Journal, XX XIIT (April, 1933), 
577-91. 

Judd, C. H. ‘‘In Defense of American 
Secondary Schools,’’ School Review, 
XLI (April, 1933), 257-65. 

Lambert, A. C. ‘*‘The Research Point 
of View in Education,’’ American 
School Board Journal, LXXXVI, 
(March, 1933), 16. 

Lindquist, E. F., and Cook, Walter W. 
‘*Experimental Procedures in ‘Test 
Evaluation,’’ Journal of Experimental 
Education, I (March, 1933), 163-85. 

Myers, Alonzo F. ‘‘An Evaluation of 
Research on Teacher Preparation,’’ 
Journal of Educational Research, 
XXVI (November, 1932), 161-74. 

Odell, C. W. ‘‘Edueational Measure- 
ment in the Secondary School,’’ Jowr- 
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nal of Educational Research, XXVI 
(October, 1932), 81-89. 

Reymert, M. L. ‘‘An Attempt at a Rat- 
ing Seale for Psychclogists,’’ Psy- 
chological Bulletin, XXX (January, 
1933), 63-79. 

Sackett, E. B. ‘‘Is Research an Ex- 
pense?’’ American School Board Jour- 
nal, LXXXVI (April, 1933), 19-20. 

Touton, F. C. ‘*‘Edueation in 1940,’’ 
Education, LITT (March, 1933), 428-35. 

Woody, Clifford. ‘‘ Whither Educational 
Research?’’ Journal of Educational 
Research, XXVI_ (October, 1932), 
136-37. 


PROBLEMS AND ISSUES: NEEDED 
RESEARCH 

Capen, 8. P. ‘‘ Report of the Committee 
on Problems and Plans in Education,’’ 
Educational Record, XIII (July, 
1932), 180-84. 

Carr, W. G. ‘‘New Angle of Attack 
Needed in Class Size Research,’’ Na- 
tion’s Schools, X (November, 1932), 
27-30. 

Chambers, M. M. ‘‘Necded Studies in 
Educational Administration,’’ Hduca- 
tional Administration and Supervision, 
XiX (April, 1933), 268-74. 

Coon, Beulah I., and others. Suggestions 
for Studies and Research in Home- 
Education: Outline of Projects Need- 
ing Investigation and Some Basic Con- 
siderations in Relation to Them. Bul- 
letin No. 166. Washington: Federal 
Board for Vocational Education, 1932. 
Pp. xi + 77. 

Cunningham, Bess V., and Connor, Ruth. 
‘*Suggested Experiments in the Field 
of Pre-parental Education,’’ Teachers 
College Record, XXXIV (January, 
1933), 285-301. 

‘Current Research Projects (1932),’’ 
American Journal of Sociology, 
XXXVIII (March, 1933), 728-54. 
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Good, Carter V. ** Doctors’ Theses 
Under Way in Edueation, 1932-1933,’ 
Journal of Educational Research, 
XXVI (January, 1933), 381-400. 

Lee, J. M. ‘‘Needed Developments in 
Measurement for Secondary Schools,’’ 
Education, LIII (March, 1933), 
424-27. 

McCloy, C. H. ‘Research in Athletics 
for Girls and Women,’’ Research 
Quarterly of the American Physical 
Education Association, III (October, 
1932), 101-04, 

New York State Education Department, 
Needed Educational Research in New 


York State. Albany: University of 
the State of New York Press, 1933. 
Pp. 16. 

‘Report of Researches in Education,’’ 


British Journal of Educational Psy- 
chology, IL (1932), 221-27. A list of 
psychological studies under way in 
Gireat Britain, which are of interest to 
workers in education. 

Symonds, P. M. ‘‘ Needed Research in 
the Teaching of English,’’ English 
Journal, College Edition, XXII (June, 
1933), 447-56. 

Taylor, A. S. ‘‘Currieular Research Is 
Urgently Needed,’’ Junior College 
Journal, III (February, 1933), 246-48. 
Deals with junier college curricular 
problems. 

Touton, F. C. ‘‘Research Projects of 
the Secondary School Level Carried on 
in California Cities During 1931-1932,’’ 
California Quarterly of Secondary 
Education, VIII (January, 1933), 
189-219. 

SOURCES OF INFORMATION: 
BIBLIOGRAPHIES, SUMMARIES, AND 
ABSTRACTS 
Abel, J. F. ** Selected References 
on Foreign Edueation,’’ Elementary 
School Journal, XX XIII (June, 1933), 


777-84. 





[ Vol. 27, No. 1 


‘*Abstracts of Unpublished Masters 
Theses, Indiana State Teachers Col 
lege, 1931 and 1922,’’ Teachers Col 
lege Journal, Iii (July, 1932), 
251-300, 

‘*Abstracts of Unpublished Masters’ 
Theses, Indiana State Teachers Col- 


‘* 


lege, 1933, Teachers College Journal, 
IV (July, 1933), 277-320. 

Affleck, G. B. ‘‘ Bibliography for 1931,’’ 
Research Quarterly of the American 
Physical. Education Association, III 
(December, 1932), 122-54. Covers the 
field of physical education. 

Alexander, Carter. ‘‘Selecting Maga 
zines for Teachers Starved for Profes 


', 


sional Vitamins, School Evrecutives 
Magazine, LIT (April, 1933), 268-70. 

An Analytical Bibliography of Modern 
Language Teaching, 1927-1932. Com 
piled for the Committee of Modern 
Language Teaching by Algernon Cole 
man, with the assistance of Agnes 
Jaeques. Chicago: University of Chi 
eago Press, 1933. Pp. xiv +- 296. 

Angrist, Charles K. ‘‘The Technique of 
Library Research for Students of Edu- 
eation.’’ Unpublished Master’s Thesis, 
College of the City of New York, 1931. 

Baker, H. J., and others. ‘‘ Tests of In 
telligence and Aptitude,’’ Review of 
Educational Research, 1 (October, 
1932), 271-342. Includes 450 refer 
ences, 

Blauech, L. E. ‘*Curriculum Surveys in 
Higher Edueation,’’ Journal of Higher 
Education, IV (May, 1933), 255-60. 
Reviews nineteen curriculum surveys. 

Brownell, William A. ‘*The Growth and 
Nature of Research Interest in Arith 
metic and Reading,’’ Journal of Edu- 
cational Research, XXVI_ (February, 
1933), 429-41. 

Campbell, Doak 8S. ‘‘ Directory of the 
Junior College, 1933,’’ Junior College 
Journal, 111 (January, 1933), 217-31. 
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Cattell, J. M. ‘*The Distribution of 
American Men of Science in 1952,’’ 
Science, LXXVII (March 10, 1933), 
264-70. 

Cook, P. A. W. ‘‘A Guide to the Litera 
ture on Negro Education,’’ Teachers 
College Record, XXXIV (May, 1933), 
671-77. 

Crabb, A. L., and others. ‘‘ Bibliography 
of Studies Dealing Wholly or in Part 
with the Training School,’’ Peabody 
Journal of Education, X (September, 
1932), 98-114. 

‘‘Cubberley (A Series of Articles on His 
Life and Work),’’ California Quar 
terly of Secondary Education, VIII 
(April, 1933), 229-49. 

‘*Edueational Books of 1932,’’ School 
and Society, XXXVII (Mareh 25, 
1933), 391-408. 

Kells, W. C. 
in the History of Edueation,’’ School 
and Society, XXXVII (January 7, 
1938), 12-13. 

Eliassen, R. H., and Anderson, E. W. 
‘* Investigation of Teacher Supply and 


**1933 as a Centennial Year 


Demand Reported Since November, 
1931.’’ Educational Research Bulletin, 
XII (March 8, 1933), 66-72. 

Fink, Stuart D., and Umstattd, J. G. 
{bstracts of Masters’ and Doctors’ 
Theses in Education, University of 
Minnesota, July 1, 1980, to July 
37. Edueational Research Bulletin 
No, 4, Eta Chapter, Phi Delta Kappa, 
College of Education, University of 

Phi Delta 


° 


Kappa, University of Minnesota, 1932. 


Minnesota. Minneapolis: 


Pp. 72. 


Freeman, F. N., and others. ‘‘ Selected 


References on Educational Psychology, 
School Review, XLI (May, 1933 
379-86. 

Friedman, Kopple C., and Nemzek, 
Claude L. ‘*‘The School Magazine in 
Educational Literature,’’ School Re 
view, XL (October, 1932), 620-26. 


AND COMMUNICATIONS 


Good, Carter V. ‘‘Selected Bibliography 
on Techniques of Edueational Research 
and Related Problems, 1931-1932,’’ 
Journal of Educational Research, 
XXVI (October, 1932), 148-60. 

Gray, William 8. ‘‘Summary of Read- 
ing Investigations (July 1, 1931, to 
June 30, 1932),’’ Journal of Educa 
tional Research, XXVI_ (February, 
1933), 401-24. 

Heck, A. O., and others, ‘‘ Pupil Person 
nel, Guidanee, and Counseling,’’ Re 
view of Educational Research, ITI 
(June, 1933), 183-278. Includes 793 
references, 

Hildreth, Gertrude H. Bibliography of 
Mental Tests and Rating Scales. New 
York: Psychological Corporation, 1955, 

Hollingworth, L. S. ‘‘Seleeted Refer 
ences from the Literature on Excep 
tional Children,’’ Elementary School 
Journal, XXXITI (May, 1933),. 
698-706. 

Holy, T. C., and others. ‘‘School Build 
ings, Grounds, Equipment, Apparatus, 
and Supplies,’’ Review of Educational 
Research, I1 (December, 1932), 345 
$42. Includes 476 references. 

Holzinger, K. J., and Swineford, 
Frances, **Selected References on 
Statistics and Theory of Test Con 
struction,’’ School Review, XLI (June, 
1933), 462-66. 

Joval, A. E. 


Theses in Education a! the University 


f{bstracts of Doctors’ 


of California, 1898 to March, 1933 
Berkeley, California: 
ter, Phi Delta Kappa, 1933. Pp. 104. 
Kitson, H. D., and Stover, FE. M. ‘* Meas 


uring Vocational Guidance: A Sum 


Lambda Chap 


mary of Attempts,’’ Personnel Jour 
nal, XT (October, 1932). J. 

Koos, Leonard V., and others. ‘‘ Selected 
References on Secondary-School In 
struction,’’ School Review, XLI (Jan 
uary, February, March, 1933), 60-66, 


129-46, 213-26. 
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Lancaster, J. H. ‘‘A Guide to the Lit- 
erature on Education of Teachers,’’ 
Educational Administration and Super- 
vision, XIX (May, 1933), 363-72. 

Lee, J. M., and Symonds, P. M. ‘‘ New 
Type or Objective Tests: A Summary 
of Recent Investigations,’’ Journal of 
Educational Psychology, XXIV (Janu- 
ary, 1933), 21-38. 

Louttit, C. M. A Handbook of Psycho- 
logical Literature. Bloomington, In- 
diana: Principia Press, 1932. 

McCloy, C. H. ‘‘ Bibliography of Health 
and Physical Education,’’ Research 
Quarterly of the American Physical 
Education Association, III (October, 
1932), 3-78. 

MeGeoch, J. A. ‘‘The Psychology of 
Human Learning: A Bibliography,’’ 
Psychological Bulletin, XXX (Janu- 
ary, 1933), 1-62. 

MeLaughlin, Katherine L. ‘‘ Selected 
References on Kindergarten-Primary 
Edueation,’’ Elementary School Jour- 
nal, XXXITI (April, 1933), 621-26. 

Meister, Morris. ‘‘ Recent Educational 
Research in Science Teaching,’’ School 
Science and Mathematics, XXXII 
(November, 1932), 875-89. 

Mikesell, Homer Earl. ‘‘The Eduea- 
tional Research Activities of the State 
of QOhio.’’ Unpublished Master’s 
thesis, Ohio State University, 1930. 

Peters, C. C., and Struck, F. T. Abstracts 
of Studies in Education at the Pennsyl- 
vania State College, Part II. Pennsyl- 
vania State Studies in Education, 
No. 4. State College, Pennsylvania, 
1932. Pp. 64. 

Pieper, C. J. ‘‘ Research Studies Relat- 
ing to the Teaching of Science,’’ 
Science Education, XVII (April 
1933), 138-50. Covers the period from 
June, 1931, to December, 1932. 

Reavis, W. C., and Henry, N. B. ‘‘Se- 
lected References on Public School 
Administration,’’ Elementary School 
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Journal, XXXIII (January, February, 
1933), 382-86, 462-66. 

Roemer, Joseph. ‘Abstracts of Unpub- 
lished Masters’ Theses in the Field of 
Secondary-School Administration. Bul 
letin of the Department of Secondary- 
School Principals of the National Edu- 
eation Association, No. 43, 1932. 
Cicero, Illinois: H. V. Church, Sec- 
retary. 

Selle, Erwin S. The Organization and 
Activities of the National Education 
Association. Teachers College Contri- 
butions to Education, No. 513. New 
York: Bureau of Publications, Teach- 
ers College, Columbia University, 1932. 

Shannon, J. R. ‘‘An Analysis of the 
Subject Matter of Education Discussed 
in Lay Magazines,’’ School and So- 
ciety, XXXVII (June 3, 1933), 715-16. 

Shannon, J. R. ‘‘ Professional Exper 
ience of Professors of Education,’’ 
School and Society, XXXVI (Novem- 
ber 12, 1932), 638-40. Based on data 
from Leaders in Education. 

‘*Sixty Educational Books of 1932,’’ 
Journal of National Education Asso- 
ciation, XXII (April, 1933), 117-20. 

Smith, H. L., and Noffsinger, F. R. 
Bibliography of School Buildings, 
Grounds, and Equipment. Bulletin of 
the School of Education, Indiana Uni- 
versity, Vol. IX, No. 2, March, 1933. 
Bloomington, Indiana: Indiana Uni- 
versity, 1933. Pp. 182. 

Stenquist, J. L., and others. ‘‘ Educa 
tional Tests and Their Uses,’’ Review 
of Educational Research, III (Febru- 
ary, 1933), 1-80. Includes a bibliog- 
raphy of 467 items. 

Stint, D. B., and Engelhart, M. D. ‘‘A 
Critical Summary of the Research 
on the Lecture-Demonstration Versus 
the Individual-Laboratory Method of 
Teaching High School Chemistry,’’ 
Science Education, XVI _ (October, 
1932), 380-91. 
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Stoddard, G. D., and others. ‘‘ Mental 
and Physical Development,’’ Review of 
Educational Research, III (April, 
1933), 81-181. Bibliography of 433 
items. 

Terry, Paul W. ‘‘Summary of Investi- 
gations of Extra-Curriculum Activities 
in 1931, I,’’ School Review, (Septem- 
ber, October, 1932), 505-14, 613-19. 

erry, Paul W. ‘‘ Selected References on 
the Extra-Curriculum,’’ School Review, 
XLI (April, 1933), 299-306. 

Theses in Education, University of Ken- 
tucky. Bulletin of the Bureau of 
School Service, Vol. V, No. 4, June, 
1933. Lexington, Kentucky: Univer- 
sity of Kentucky, 1933. Pp. 62. 

Tinker, M. A. ‘* Diagnostic and Reme- 
dial Reading,’’ Elementary School 
Journal, XX XIIT (December, 1932, and 
January, 1933), 293-306, 346-57. <A 
summary of studies in this field. 

Witmer, Eleanor M., and _ Miller, 
Margaret C. ‘‘United States Office 
of Edueation Serial Publications,’’ 
Teachers College Record, XXXIV 
(January, 1933), 302-11. 

Wright, Edith A. Bibliography of Re- 
search Studies in Education: 1930- 
19381. Office of Education Bulletin, 
No. 16, 1932. Washington: Office of 
Edueation. Pp. xviii + 460. 

Wright, Edith A. List of Educational 
Research Studies of State Departments 
of Education and State Education 
Associations, 1981-1982. Cireular No. 
63, October, 1932. Washington: 
Office of Education. Pp. 44. 

Young, Grace P. ‘‘Bibliography of 

Modern Language Methodology in 

America for 1932,’’ Modern Language 

Journal, XVII (May, 1933), 600-615. 


COLLECTING, ANALYZING, INTERPRETING, 
AND REPORTING DATA 

Abelson, Harold H. The Art of Educa- 

tional Research: Its Problems and 
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Procedures. Yonkers-on-Hudson, New 
York: World Book Co., 1933. Pp. 
xii + 332. 

Barr, A. 8. ‘‘The Integration of Sei- 
entific Techniques in Educational Re- 
search,’’ Journal of Educational 
Research, XXVI (November, 1932), 
219-21. 

Breed, Frederick S. ‘‘The Nature of 
Educational Measurement,’’ School 
Review, XL (September, 1932), 
497-504. 

Campbell, L. R. ‘‘ Editing the Curricu- 
lum,’’ School and Society, XXXVII 
(February 25, 1933), 251-56. 

Caswell, H. L. ‘*‘ Definition and Classi 
fication of Surveys,’’ Peabody Journal 
of Education, X (November, 1932), 
179-81. 

Cavan, Ruth 8. ‘‘The Questionnaire in 
a Sociclogical Research Project,’’ 

American Journal of Sociology, 
XXXVIII (March, 1933), 721-27. 

Cozens, F. W. ‘‘The Technique of a 
School Survey in Health and Physical 
Edueation,’’ Research Quarterly of the 
American Physical Education Associa 
tion, III (December, 1931), 3-20. 

Davis, E. C. ‘‘The Survey and Profes 
sional Preparation in Physical Educa 
tion,’’ Research Quarterly of the 
American Physical Education Associa 
tion, IIL (December, 1932), 21-32 

Davis, R. A., and Wilbur, M. J. ‘‘Cur 
riculum Research,’’ Journal of Experi 
mental Education, I (June, 1933), 
294-97. An analysis of purposes, 
methods, and devices of research in 
this field from 1921-31. 

Edwards, Newton. The Courts and the 
Public Schools. Chicago: University 
of Chicago Press, 1933. Pp. xvi + 582. 

Ellwood, C. A. ‘‘Seientific Method in 
Sociology,’’ Social Forces, XI (Octo- 
ber, 1932), 44-50. 

Foster, F. M. ‘‘Uniformity in Adminis- 
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trative Nomenclature,’’ Junior College 
Journal, IIT (April, 1933), 362-64. 

Kelley, T. L. Setentific Method: Its 
Function in Research and in Education. 
New York: Macmillan Co., 1932. 
Pp. x + 234. 

Knudsen, Charles W. ‘‘Critical Study 
with a Minimum of Research,’’ Journal 
of Educational Research, XXVI (Feb- 
ruary, 1933), 457. 

Monroe, Walter S. ‘‘Standardization of 
Statistical Symbolism,’’ Journal of 
Experimental Education, I (March, 
1933), 223-28. 

Monroe, Walter 8., and Stuit, Dewey B. 
‘*The Interpretation of the Coefficient 
of Correlation,’’ Journal of Experi- 
mental Education, I (March, 1933), 
186-2038. 

Morrow, P. R., and Mishoff, W. O. A 
Guide to Thesis Writing. Athens, 
Georgia: University of Georgia, 1932. 
Pp. 20. 

Rusk, Robert R. Research in Education: 
An Introduction. London, England: 
University of London Press, Ltd., 
1932. Pp. 108. 

Sears, J. B. ‘‘The Function of Research 
in Curriculum Making,’’ California 
Quarterly of Secondary Education, 
VIIL (January, 1933), 147-53. 

Smith, Mapheus. ‘‘A Note on Stability 
in Questionnaire Response,’’ American 
Journal of Sociology, XXXVIII 
(March, 1933), 713-20. 

Toops, Herbert A. ‘‘Some Considera- 
tions Relative to the Standardization 
of Certain Procedures in Educational 
Research,’’ Journal of Experimental 
Education, 1 (March, 1933), 229-38. 

Upshall, C. C., and Masters, H. V. ‘‘ Re- 
search in Education — Interpretive 
Hazards,’’ School and Society, XXXVI 
(December 31, 1932), 851-53. 

West, Paul V. ‘‘ Need for Standardiza- 
tion of Symbols and Formulae in Edu- 


’, 


cational Statistics,’’ Journal of Ex- 
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perimental Education, I (March, 1933), 
216-22. 

Whitley, Robert Love. ‘‘The Case Stud) 
as a Method of Research.’’ Unpub- 
lished Doetor’s thesis, New York Uni 
versity, 1931. 

Woodard, J. W. ‘‘Critical Notes on 
the Nature of Sociology as a Science,’’ 
Social Forces, XI (October, 1932), 
28-43. 

Woody, Clifford, and Sangren, Paul V. 
Administration of the Testing Pro 
gram. Yonkers-on-Hudson, New York: 
World Book Co., 1932. Pp. xii + 398. 

Worcester, D. A. ‘‘Has Standardized 
Testing Been Over -emphasized?’’ 
School Executives Magazine, LI (July, 
1932), 467-69, 490. 


TRAINING RESEARCH WORKERS AND 
GUIDANCE OF GRADUATE STUDENTS 
Agunod, Nemesio L. ‘‘The Bureau of 
Research and Reference in Americar 
School Systems.’’ Doctor’s thesis, 
Teachers College, Columbia University, 

1951. 

Betts, G. H. ‘‘General Information 
Possessed by Graduate Students in 
Edueation,’’ School and Society, 
XXXVII (June 24, 1933), 821-24. 

Betts, G. H. ‘‘Subsidizing Graduate 
Study,’’ Journal of Higher Education, 
III (November, 1932), 415-18. 

Brueekner, L. J. ‘‘ Planned Programs 
of Research,’’ Journal of Educational 
Research, XXVI (January, 1933), 
364-66. 

Carpenter, W. W., and Rosenstengel, 
W. E. ‘* Participation of State Uni 
versities in School Plant Surveys,’’ 
School Executives Magazine, LII (No 
vember. 1932), 122-23. 

Clark, Robert. ‘‘The Mobility of Public 
School Administrators,’’ School and 
Society, XXXVI (October 15, 1932), 
506-08, 

Charters, W. W., and others. ‘‘ Annual 
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Report of the Bureau of Educational 

Research, Ohio State University,’’ 

Educational Research Bulletin, XI 

October 12, 1932), 309-36. 
per, W. J. ‘*‘ The Scientific Work of 

the Government of the United States,’’ 
Scientific Monthly, XXXVI (February, 
1933), 121-30. 
yper, W. J. ‘‘ Professional Leadership 
in Edueation,’’ School and Society, 
XXXVII (March 11, 1933), 305-12. 
oxe, W. W. ‘*The Coérdination of Re- 
search by State Departments of Edu 
eation,’’ School and Society, XXXVII 
June 10, 1933), 729-35. 

Edmonson, J. B. ‘‘A University’s Pro 
gram of Research in Elementary Edu 
eation,’’ Elementary School Journal, 
XXXIIT (October, 1952), 106-11. 

Fernberger, S. W. ‘*Objective Control 
of One Factor in the Granting of Post 
Graduate Fellowships and Scholar 
ships,’’ Sehool and Society, XXXVII 
June 17, 1933), 787-92. 

Gilbert, L. C. ‘* Professional Reading of 
Young Students of 
School Review, XL (October, 1932), 
606-12. 

Good, Carter V. 


Edueational Research,’’ 


Education,’’ 


‘*Cautions to the Be 

ginner in 

Journal of Educational § Research, 
XXVI (December, 1932), 302-4. 

Harris, R. G. ‘*‘The Doctorate and the 
Depression, ’’ School and _ Society, 
XXXVI (October 15, 1932), 498-500. 

Hull, Callie, and West, C. J. ‘*The 
Eighth Census of Graduate Research 
Students in Chemistry, 1931,’’ Journal 
of Chemical Education, IX (August, 
1932), 1472-73. 

Hull, Callie, and West, C. J. ‘‘The 
Ninth Census of Graduate Research 
Students in Chemistry, 1932,’’ Journal 
of Chemical Education, X (August, 
1933), 499-503. 

Larson, E. L. ‘‘Major Problems Relat 


ing to the Master’s Degree in Educa 


AND COMMUNICATIONS 


tion,’’ Educational Administration 
and Supervision, XVIII (December, 
1932), 699-711. 

MacNeel, Joseph Raymond. Admission 
of Students as Candidates for Master’s 
Degree. Teachers College Contribu- 
tions to Edueation, No. 524. New 
York: Bureau of Publications, Teach 
ers College, Columbia University, 1932. 

Monroe, W. 8. 
Education, 1928-1933,’’ School and 
Society, XXXVII (March 4, 1933), 
2S9-90, 

Nelson, R. W. ‘<Theaetetus Ph.D.,’’ 
Journal of Higher Education, IV 


(May, 1933), 234-40. Criticism of re 


‘*Doctors’ Degrees in 


strictions placed upon Doctors’ candi 
dates in working out their programs 
and theses. 

Rogers, L. B. ‘*The Place of Schools of 
Education in the Program of Improve 
ment of University Instruction,’’ 
School and Society, XXXVI (August 
27, 19382), 257-64. 

Ruckmick, C. A. ‘‘The Future of the 
Doctoral Degree,’’ School and Society, 
XXXVII (February 18, 1933), 201-6. 


Seates, D. E. ‘‘ Training for Research in 


the Light of Field Requirements,’’ 
Elementary School Journal. XXXIII 
(October, 1932), 96-105. 

Sears, Jesse B. ‘‘ The Administration of 
Publie School Research 
Journal of Educational 
XXVI (November, 1932), 186-98, 


Shannon, J. R. ‘‘Geographical Distribu 


Policies,’’ 


Re seare h, 


tion of Teachers in Edneation,’’ School 
and Nocte ty, XXXVI 


1932), 720-22. Based on an anaiysis 


» 


December 


of ‘‘Leaders in Education: A _ Bio 
graphical Directory.’’ 
Strang, Ruth. ‘*Voeational Paths to 
Certain Educational Positions,’’ School 
and Society, XXXVI October 15. 
1932), 508-12. 


Stratton, Dorothy C. Problems of Stu 


dents in a Graduate School of Educa 
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tion. Teachers College Contributions 
to Edueation, No. 55 


550. New York: 
Teachers College, Columbia Univer 
sity, 1933, 

Symonds, P. M. ‘‘Characteristies of a 

Education,’’ 

Record, XXXIV 


January, 1933), 312-26. 


Good Dissertation in 


Teachers College 


Toops, “aura C. ‘* Research for Teach- 


ers in Training,’’ Teachers College 
Record, XXXIV (December, 1932). 
228-34. A plan for codérdinating 


coéperative and individual research ap- 
plied in a research program for a class 
of prospective teachers in nursery 
schools. 

‘Training for Research in the Social 
Sciences,’’ Educational Record, XIV 
April, 1935 152-61. 
quirements for graduate degrees. 

Walker, Helen M. 


Training of Research Workers,’’ Jour 


Discusses re 


‘*Problems in the 





nal of Educational Research, XXVI 
(February, 1933), 442-48. 

West, Clarence J., and Hull, Callix 
‘* Doctorates in Chemistry and Related 
Fields Conferred by American Unive: 
sities, 1931-32,’’ Journal of Chemical 
Education, IX (November, 1932), 
1975-96. 

Zeigel, William H., Jr. ‘‘ Research for 
Secondary Schools,’’ School Review, 
XLI (January, 1933), 27-39. 

Zeigel, William H., Jr. Research in Se 
ondary Schools. Office of Education 
Bulletin, No. 17, 1932, Monograph No 
15, National Survey of Secondary Edu 

Washington: Office of Edu 


72. 


cation. 
eation, 1933. Pp. vi 
Zook, G. F., and others. ‘‘ Report of th 
Committee on Revision of Standards,’’ 
North Central Association Quarterly, 


VII (September, 1932), 185-205. 


[ Vol. 27, No. 1 


eee 


eee 


SS Wie ah 


_ 


. 








